-- Logs begin at Thu 2020-12-03 14:18:35 UTC, end at Thu 2020-12-03 15:23:02 UTC. -- Dec 03 14:52:54.445776 dv-cinder-757908-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 03 14:52:54.454249 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: *** Starting uWSGI 2.0.15-debian (64bit) on [Thu Dec 3 14:52:54 2020] *** Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: nodename: dv-cinder-757908-3-iscsi Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: machine: x86_64 Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: clock source: unix Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: pcre jit disabled Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: detected number of CPU cores: 4 Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: current working directory: / Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: detected binary path: /usr/bin/uwsgi-core Dec 03 14:52:54.456215 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: dropping root privileges as early as possible Dec 03 14:52:54.457205 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: your processes number limit is 47843 Dec 03 14:52:54.457205 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: your memory page size is 4096 bytes Dec 03 14:52:54.457205 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: detected max file descriptor number: 2048 Dec 03 14:52:54.457205 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: lock engine: pthread robust mutexes Dec 03 14:52:54.457205 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: thunder lock: enabled Dec 03 14:52:54.457205 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 03 14:52:54.457205 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: dropping root privileges after socket binding Dec 03 14:52:54.457205 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Dec 03 14:52:54.501995 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: Python main interpreter initialized at 0x557942e509c0 Dec 03 14:52:54.501995 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: dropping root privileges after plugin initialization Dec 03 14:52:54.501995 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: python threads support enabled Dec 03 14:52:54.501995 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: your server socket listen backlog is limited to 100 connections Dec 03 14:52:54.501995 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: your mercy for graceful operations on workers is 90 seconds Dec 03 14:52:54.502504 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: mapped 402621 bytes (393 KB) for 2 cores Dec 03 14:52:54.502504 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: *** Operational MODE: preforking *** Dec 03 14:52:54.502673 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: dropping root privileges after application loading Dec 03 14:52:54.502673 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: *** uWSGI is running in multiple interpreter mode *** Dec 03 14:52:54.502673 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: spawned uWSGI master process (pid: 79702) Dec 03 14:52:54.503547 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: spawned uWSGI worker 1 (pid: 79703, cores: 1) Dec 03 14:52:54.503547 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: spawned uWSGI worker 2 (pid: 79704, cores: 1) Dec 03 14:52:54.503547 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 03 14:52:54.502811 dv-cinder-757908-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 03 14:52:58.956161 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 03 14:52:58.956682 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 03 14:52:58.957051 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 03 14:52:58.957365 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 03 14:52:58.958022 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 03 14:52:58.958451 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 03 14:52:58.958740 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 03 14:52:58.958970 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 03 14:52:58.959198 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.959401 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 03 14:52:58.959565 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.959671 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 03 14:52:58.959928 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.960130 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.960305 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.960500 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.960661 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.960862 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.961020 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.961241 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.961389 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.961602 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.961704 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.961997 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.962115 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.962371 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.962477 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.962721 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.962818 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.963026 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.963133 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.963379 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.963483 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.963746 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-757908-3-iscsi {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.963842 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.964033 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.964140 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.964391 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.964734 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.964848 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-757908-3-iscsi {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.964943 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.965204 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.965307 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.965552 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.965649 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.965934 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.966044 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.966279 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.966376 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.966620 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.966892 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.967000 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.967239 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.967335 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.967581 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.967891 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.967994 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.968245 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.968348 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.968593 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.968694 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.968933 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.969038 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.969295 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.969391 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.969641 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.969746 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.970025 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.970149 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.970379 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.970496 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.970718 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.970819 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-757908-3-iscsi {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.971071 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.971171 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.971416 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.971521 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.971759 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.971871 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-757908-3-iscsi {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.972109 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.972246 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.972462 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.972579 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.972818 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.972925 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.973250 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.973356 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.973613 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.973719 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.973976 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.974081 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.974351 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.974463 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.974707 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.974814 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.975058 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.975163 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.975408 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.975514 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.975745 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.975856 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.976090 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.976189 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.976435 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.976540 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.976768 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.976872 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.977107 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.977206 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.977448 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.977551 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.977732 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.977839 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.978103 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.978235 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.978469 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.978588 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.978756 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.978876 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.979108 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.979219 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.979428 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.979536 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.979710 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.979810 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.980072 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.980680 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.980930 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.981035 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.981292 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.981474 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.981579 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.981869 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.982045 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.982228 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.982337 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.982443 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.982590 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.982696 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.982916 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.983015 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.983265 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.983369 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.983605 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.983709 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.983946 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.984044 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.984301 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.984417 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.984651 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.984762 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.984987 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.985086 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.985347 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.985448 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.985717 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.985822 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.63 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.986091 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.986203 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.63 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.986435 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.986536 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.986821 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.986922 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.63 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.987151 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.63 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.987250 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.987499 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.987598 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.987859 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.987963 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.988214 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.988325 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.988556 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.988668 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.988898 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.989003 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.989248 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.989374 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.989587 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.989692 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.989975 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.990089 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.990287 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.990394 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.990570 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.990669 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.990912 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.991010 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.991255 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.991362 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.991562 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.991665 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.991904 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.992008 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.992249 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.992363 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.992590 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.992694 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.992929 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.993028 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.993271 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.993376 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.993607 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.993712 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.993959 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.994062 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.994313 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.994419 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.994652 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.994784 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.994990 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.995090 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.995333 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.995437 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.995665 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.995765 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.996558 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.996664 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.997092 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.997209 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.997343 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.997443 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.997682 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.997780 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.998049 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.998153 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.998397 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.998496 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.998745 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.998866 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.999082 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.999180 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.999446 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.999583 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.999762 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:58.999869 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.000118 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.000225 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.000459 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.000565 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.000793 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.000902 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.001155 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.001261 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.001491 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.001595 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.001826 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.001969 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.002206 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.002310 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.002543 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.002648 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.002886 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.002985 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.003237 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.003336 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.003571 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.003672 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.003904 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.004009 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.004244 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.004343 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.004583 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.004681 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.004920 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.005019 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.005252 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.005351 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.005588 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.005687 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.005947 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.006050 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.006279 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.006384 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.006625 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.006723 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.006968 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.007073 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.007305 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.007404 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.007649 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.007759 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.007991 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.008096 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.008334 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.008433 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.008682 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.008847 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.009031 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.009131 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.009397 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 14:52:59.009496 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.009742 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.009852 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.010161 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.010268 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.010535 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.010638 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.010884 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.010983 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.011227 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.011326 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.011661 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.011770 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.012026 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.012171 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.012364 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.012535 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.012693 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.012796 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.013056 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.013162 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.013409 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.013508 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.013758 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.013863 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.014135 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.014238 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.014486 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.014589 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.014839 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.014951 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.015193 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.015303 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.015540 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.015639 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.015891 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.015998 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.016251 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.016356 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.016595 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.016705 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.016935 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.017034 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.017301 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.017401 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.017665 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.017772 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.018033 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.018139 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.018401 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.018500 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.018751 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.018862 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.019117 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.019232 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.019466 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.019615 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.019816 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.019927 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.020161 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.020261 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.020511 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.020616 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.020863 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.020963 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.021212 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.021312 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.021569 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.021668 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.021927 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.022029 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.022291 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.022400 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.022636 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.022737 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.022978 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.023082 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.023320 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.023436 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.023653 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.023761 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.023998 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.024103 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.024353 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.024460 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.024691 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.024790 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.025049 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.025154 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.025385 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.025492 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.025733 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.025833 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.026108 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.026208 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.026452 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.026563 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.026801 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.026899 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.027167 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.027390 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.027623 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.027740 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.027940 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.028040 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.028283 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.028389 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.028625 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.028732 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.028981 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.029080 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.029326 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.029424 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.029668 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.029768 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.030041 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.030145 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.030391 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.030490 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.030733 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.030834 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.031082 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.031187 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.031470 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.031581 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.031778 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.031879 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.032126 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.032227 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.032499 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.032604 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.032856 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.032963 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.033193 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.033279 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.033564 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.033681 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.033969 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.034076 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.034290 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.034389 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.034640 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.034750 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.034991 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.035091 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.035335 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.035443 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.035673 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.035781 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.036008 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.036113 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.036349 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.036454 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.036684 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.036848 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.037023 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.037122 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.037359 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.037459 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.037693 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.037803 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.038057 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.038161 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.038400 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.038499 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.038747 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.038853 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.039085 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.039186 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.039420 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.039520 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.039763 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.039863 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.040103 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.040202 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.040450 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.040554 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.040796 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.040902 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.041161 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.041261 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.041510 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.041615 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.041861 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.041993 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.042242 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.042351 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.042591 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.043211 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.043467 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.043583 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.043814 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.043915 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.044164 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.044274 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.044516 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.044616 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.044870 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.044969 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.045213 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.045309 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.045563 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.045663 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.045948 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.046052 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.046296 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.046407 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.046639 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.046744 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.046992 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.047091 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.047364 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.047473 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.047703 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.047802 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.048050 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.048155 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.048393 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.048493 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.048740 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.048847 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.049082 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.049181 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.049427 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.049527 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.050049 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.050170 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.050390 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.050489 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.050732 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.050832 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.051076 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.051176 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.051415 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.051515 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.051761 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.051861 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.052101 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.052201 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.052439 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.052538 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.052777 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.052877 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.053120 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.053220 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.053466 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.053577 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.053812 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.053949 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.054185 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.054285 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.054540 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.054653 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.054883 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.054981 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.055223 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.055322 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.055582 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.055698 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.055922 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.056022 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.056260 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.056359 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.056593 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.056699 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.056938 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.057047 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.057274 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.057374 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.057618 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.057725 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.057990 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.058133 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.058522 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.058998 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.059335 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.059840 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.059967 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.060089 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.060385 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.060502 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.060738 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.061001 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.061108 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.061417 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.061629 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.061785 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.062172 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.062279 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.062527 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.062699 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.062883 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.063240 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.063351 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.063596 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.063958 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.064116 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.064327 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.064605 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.064756 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.065004 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.065164 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.065358 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.065463 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.065704 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.065856 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.066133 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.066499 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.066650 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.072165 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.072318 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.072428 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.072535 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.072636 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.072731 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.072843 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.073013 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.073147 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.073282 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.073419 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.073547 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.073688 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.073819 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.073819 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.074663 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.074845 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.075050 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.075305 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.075446 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.075582 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.075765 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.075895 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.075895 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.076172 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.076303 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.076439 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.076575 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.076710 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.076845 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.077056 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.077193 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.077325 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.077468 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.077602 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.077752 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.077893 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.078087 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.078239 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.078380 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.078524 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.078668 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.078801 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.078944 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.079092 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.079224 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.079359 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.079506 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.079652 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.079652 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.079906 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.080043 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.080180 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.080333 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.080464 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.080591 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.080713 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.080853 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.080992 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.081147 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.081280 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.081417 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.081555 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.081692 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.081838 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.082010 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.082137 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.082280 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.082413 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.082548 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.082696 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.082828 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.082968 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.083101 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.083247 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.083380 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.083536 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.083724 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.083853 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.084035 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.084163 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.084354 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.084505 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.084644 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.084779 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.084915 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.085049 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.085185 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.085330 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.085463 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.085597 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.085740 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.085982 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.086128 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.086265 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.086407 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.086562 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.086697 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.086835 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.086983 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.087128 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.087263 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.087401 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.087539 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.087678 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.087826 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.087962 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.088100 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.088242 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.088381 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.088528 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.088674 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.088808 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.088945 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.089083 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.089221 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.089359 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.089541 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.090491 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.090629 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.090753 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.090889 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.091032 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.091167 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.091301 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.091436 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.091572 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.091717 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.091875 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.092006 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.092142 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.092292 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.092426 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.092562 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.092715 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.092848 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.092993 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.093126 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.093275 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.093409 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.093559 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.093701 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.093888 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.094059 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.094241 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.094385 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.094519 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.094659 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.094806 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.094947 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.095080 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.095225 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.095359 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.095503 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.095644 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.095777 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.095920 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.096117 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.096248 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.096385 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.096525 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.096671 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.096805 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.096951 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.097083 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.097217 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.097352 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.097494 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.097494 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.097759 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.097893 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.098057 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.098194 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.098335 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.098485 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.098622 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.098768 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.098901 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.099038 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.099175 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.099322 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.099455 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.099455 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.099774 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.099921 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.100055 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.100207 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.100342 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.100486 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.100621 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.100759 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.100882 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.101021 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.101172 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.101309 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.101447 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.101586 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.101726 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.101726 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.102102 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.102253 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.102385 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.102522 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.102667 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.102800 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.102944 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.103080 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.103219 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.103355 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.103500 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.103634 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.103774 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.103909 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.104033 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.104237 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.104486 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.104624 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.104763 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.104903 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.105048 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.105253 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.105418 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.105613 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.105744 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.106197 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.106354 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.106477 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.106609 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.106744 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.106872 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.107103 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.107237 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.107445 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.107584 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.107797 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.107938 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.108137 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.108267 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.108477 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.108609 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.108817 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.108956 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.109158 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.109288 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.109498 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.109628 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.109863 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.110017 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.110240 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.110369 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.110583 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.110713 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.110941 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.111100 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.111283 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.111432 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.111632 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.111763 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.111976 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.112115 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.112342 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.112482 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.112691 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.112823 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.113130 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.113261 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.113477 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.113624 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.113830 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.114033 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.114231 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.114360 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.114545 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.114684 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.114819 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.114959 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.115176 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.115305 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.115547 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.115675 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.115893 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.116023 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.116244 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.116440 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.116580 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.116723 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.116929 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.117058 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.117264 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.117393 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.117617 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.117749 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.118009 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.118143 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.118354 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.118485 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.118700 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.118830 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.119046 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.119217 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.119412 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.119544 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.119760 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.119899 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.120123 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.120254 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.120582 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.120723 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.120953 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.121100 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.121428 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.121565 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.121787 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.121991 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.122167 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.122347 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.122522 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.122698 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.122897 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.123042 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.123270 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.123400 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.123627 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.123758 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.123989 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.124130 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.124318 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.124446 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.124703 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.124847 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.125038 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.125167 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.125395 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.125525 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.125757 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.125886 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.126137 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.126268 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.126502 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.126647 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.126842 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.126973 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.127212 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.127343 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.127580 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.127725 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.127935 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.128073 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.128276 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.128406 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.128625 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.128763 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.128976 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.129118 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.129326 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.129457 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.129675 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.129806 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.130069 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.130216 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.130416 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.130547 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.130770 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.130901 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.131109 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.131252 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.131463 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.131614 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.131795 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.131932 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.132132 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.132274 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.132493 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.132623 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.132833 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.132970 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.133184 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.133324 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.133533 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.133664 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.133873 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.134046 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.134242 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.134429 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.134560 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.134699 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.134924 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.135070 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.135270 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.135401 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.135618 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.135750 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.135963 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.136093 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.136301 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.137139 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.137305 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.137499 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.137573 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.137642 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.137935 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.138081 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.138271 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.138401 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.138611 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.138741 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.138957 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.139087 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.139302 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.139439 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.139675 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.139815 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.140012 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.140142 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.140372 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.140500 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.140742 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.140887 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.141082 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.141220 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.141429 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.141559 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.141778 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.141957 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.142161 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.142299 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.142507 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.142638 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.142846 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.142977 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.143201 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.143331 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.143542 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.143671 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.143883 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.144021 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.144222 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.144351 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.144577 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.144732 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.144893 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.145017 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.145209 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.145345 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.145545 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.145675 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.145886 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.146102 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.146256 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.146413 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.146549 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.146681 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.146910 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.147051 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.147260 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.147420 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.147614 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.147753 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.147964 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.148093 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.148308 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.148437 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.148649 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.148777 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.148994 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.149134 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.149358 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.149491 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.149700 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.149830 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.150086 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.150218 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.150436 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.150575 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.150792 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.150935 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.151154 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.151287 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.151499 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.151629 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.151870 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.152674 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.152819 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.152965 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.153103 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.153232 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.153461 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.153609 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.153815 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.153971 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.154192 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.154488 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.154647 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.154883 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.155043 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.155212 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.155362 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.155593 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.155872 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.156056 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.156229 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.156402 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.156576 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.156749 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.156920 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.157185 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.157325 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.157558 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.157697 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.157959 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.158108 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.158296 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.158426 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.158650 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.158780 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.159001 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.159146 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.159364 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.159497 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.159713 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.159842 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.160066 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.160212 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.160418 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.160556 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.160755 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.160895 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.161103 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.161232 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.161472 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.161626 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.161842 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.162027 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.162222 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.162425 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.162635 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.162812 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.162985 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.163171 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.163344 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.163516 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.163697 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.163877 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.164048 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.164233 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.164233 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.164562 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.164748 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.164957 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.165238 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.165423 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.165597 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.165769 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.165979 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.166154 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.166342 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.166522 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.166694 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.166867 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.166867 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.167204 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.167400 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.167554 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.167715 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.167851 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.167987 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.168122 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.168273 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.168406 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.168547 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.168681 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.168805 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.168999 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.169146 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.169362 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.169493 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.169717 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.169848 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.170097 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.170232 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.170451 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.170590 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.170798 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.170929 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.171150 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.171389 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.171519 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.171747 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.171887 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.172122 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.172263 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.172479 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.172732 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.172905 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.173077 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.173265 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.173438 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.173610 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.173782 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.173996 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.174171 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.174360 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.174533 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.174930 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.175064 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.175064 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.175514 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.175660 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.175792 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.175927 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.176071 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.176212 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.176347 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.176492 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.176625 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.176761 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.176986 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.177126 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.177334 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.177464 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.177717 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.177964 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.178098 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.178376 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.178523 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.178739 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.178891 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.179094 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.179290 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.179418 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.179575 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.179749 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.179888 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.180097 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.180227 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.180439 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.180630 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.180763 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.180898 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.181136 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.181273 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.181411 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.181558 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.181766 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.181896 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.182135 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.182265 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.182486 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.182644 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.182814 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.182936 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.183150 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.183818 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.184104 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.184242 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.184500 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.184637 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.184805 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.184953 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.185266 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.185410 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.185569 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.185706 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.185839 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.186000 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.186156 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.186287 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.186502 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.186658 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.186795 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.186941 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.187117 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.187256 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.187455 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.187586 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.187792 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.187933 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.188134 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.188263 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.188475 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.188614 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.188819 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.189025 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.189164 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.189328 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.189465 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.189600 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.189781 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.189946 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.190170 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.190321 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.190514 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.190645 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.190879 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.191020 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.191204 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.191345 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.191536 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.191815 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.191969 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.192199 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.192344 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.192581 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.192786 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.192915 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.193125 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.193256 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.193396 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.193585 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.193725 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.193973 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.194122 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.194310 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.194550 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.194681 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.194928 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.195059 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.195287 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.195426 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.195657 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.195788 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.196008 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.196148 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.196353 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.196483 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.196704 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.196850 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.197034 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.197182 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.197377 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.197518 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.197718 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.197850 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.198088 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.198234 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.198431 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.198562 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.198780 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.198943 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.199229 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.199419 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.199654 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.199828 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.200002 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.200184 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.200372 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.200547 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.200720 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.200893 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.201065 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.201248 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.201513 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.201689 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.201862 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.202079 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.202253 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.202427 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.202631 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.202760 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.202952 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.203131 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.203131 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.203464 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.203644 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.203825 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.204017 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.204190 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.204367 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.204553 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.204735 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.204908 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.205096 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.205271 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.205448 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.205628 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.205823 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.206019 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.206148 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.206272 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.206412 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.206564 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.206701 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.206910 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.207054 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.207190 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.207335 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.207469 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.207605 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.207743 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.207878 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.208014 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.208158 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.208292 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.208427 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.208561 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.208703 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.208838 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.208985 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.209118 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.209300 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.209443 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.209577 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.209757 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.209956 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.210145 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.210345 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.210476 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.210678 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.210822 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.211040 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.211180 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.211423 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.211568 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.211773 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.211913 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.212123 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.212254 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.212474 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.212607 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.212849 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.212989 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.213155 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.213316 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.213498 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.213630 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.213850 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.214022 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.214235 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.214367 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.215138 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.215281 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.215474 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.215699 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.215873 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.216119 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.216255 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.216437 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.216577 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.216809 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.216958 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.217172 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.217369 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.217573 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.217762 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.217996 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.218172 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.218355 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.218529 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.218700 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.218888 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.219061 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.219233 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.219429 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.219566 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.219705 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.219850 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.219983 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.220128 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.220262 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.220407 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.220555 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.220688 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.220823 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.220958 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.221193 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.221324 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.221565 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.221705 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.221899 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.222064 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.222269 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.222401 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.222622 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.222753 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.222997 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.223195 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.223324 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.223471 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.223648 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.223779 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.224010 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.224140 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.224356 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.224497 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.224718 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.224858 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.225067 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.225198 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.225414 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.225555 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.225760 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.225891 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.226143 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.226290 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.226509 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.226656 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.226862 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.226993 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.227220 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.227418 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.227558 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.227694 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.227888 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.228028 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.228242 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.228380 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.228594 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.228731 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.228961 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.229103 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.229240 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 03 14:52:59.229375 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.229666 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.230058 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.230584 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.230975 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.231367 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.231742 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 14:52:59.232020 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79703) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 03 14:52:59.267583 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79704) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 14:52:59.269020 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79703) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 14:52:59.606818 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.context [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c87cfc1d-53de-458d-8ab1-34bf80d29b3b(cell1) {{(pid=79704) load_cells /opt/stack/nova/nova/context.py:467}} Dec 03 14:52:59.607929 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.context [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c87cfc1d-53de-458d-8ab1-34bf80d29b3b(cell1) {{(pid=79703) load_cells /opt/stack/nova/nova/context.py:467}} Dec 03 14:52:59.612268 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 14:52:59.613338 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 14:52:59.614127 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 14:52:59.614995 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 14:52:59.615202 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 14:52:59.616071 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 14:52:59.618813 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=79704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 14:52:59.619863 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 14:52:59.643827 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79704) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 14:52:59.645069 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79703) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 14:52:59.653632 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79704) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 14:52:59.655883 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79703) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 14:52:59.679192 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79704) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 14:52:59.680436 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_db.sqlalchemy.engines [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79703) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 14:52:59.858106 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Loading Gnome Dec 03 14:52:59.860219 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Loading Gnome Dec 03 14:52:59.879410 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Loading Google Dec 03 14:52:59.881364 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Loading Google Dec 03 14:52:59.882829 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Loading Windows (alt) Dec 03 14:52:59.884624 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Loading Windows (alt) Dec 03 14:52:59.887504 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Loading file Dec 03 14:52:59.888608 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Loading keyczar Dec 03 14:52:59.889054 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Loading multi Dec 03 14:52:59.889298 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Loading file Dec 03 14:52:59.889945 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Loading pyfs Dec 03 14:52:59.890415 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Loading keyczar Dec 03 14:52:59.890862 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Loading multi Dec 03 14:52:59.891721 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO keyring.backend [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Loading pyfs Dec 03 14:53:00.180399 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WARNING keystonemiddleware.auth_token [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 14:53:00.188089 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WARNING keystonemiddleware.auth_token [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 14:53:00.216242 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WARNING keystonemiddleware.auth_token [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 14:53:00.227612 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WARNING keystonemiddleware.auth_token [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 14:53:00.569953 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WARNING keystonemiddleware.auth_token [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 14:53:00.576796 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WARNING keystonemiddleware.auth_token [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 14:53:00.582615 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557942e509c0 pid: 79703 (default app) Dec 03 14:53:00.584876 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:53:00.586120 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-f88306eb-3ce5-4f0c-9fdc-b8594d4509e8 None None] 10.222.0.63 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001825 Dec 03 14:53:00.586809 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 1/1] 10.222.0.63 () {50 vars in 779 bytes} [Thu Dec 3 14:53:00 2020] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:53:00.637453 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WARNING keystonemiddleware.auth_token [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 14:53:00.644330 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WARNING keystonemiddleware.auth_token [None req-10bab83a-9c14-4b0d-a243-4f212602a0dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 14:53:00.649942 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557942e509c0 pid: 79704 (default app) Dec 03 14:54:26.567830 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-4f91e49b-6e2e-4801-a641-f8e25e22632c admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:26.594377 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-4f91e49b-6e2e-4801-a641-f8e25e22632c admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.514418 Dec 03 14:54:26.594990 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 2/2] 10.222.0.63 () {58 vars in 1150 bytes} [Thu Dec 3 14:54:26 2020] GET /compute/v2.1/flavors/detail => generated 15 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:29.432915 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-61eadce3-b27b-42c4-8400-a135a05266e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:29.462171 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 14:54:29.462171 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: warnings.warn(msg) Dec 03 14:54:29.490008 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-61eadce3-b27b-42c4-8400-a135a05266e2 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.413026 Dec 03 14:54:29.490640 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 1/3] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:29 2020] POST /compute/v2.1/flavors => generated 367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:29.507001 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-9dce30c1-4606-40a8-b2b4-af0c0ad89d74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:29.514615 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 14:54:29.514615 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: warnings.warn(msg) Dec 03 14:54:29.552176 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-9dce30c1-4606-40a8-b2b4-af0c0ad89d74 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.054380 Dec 03 14:54:29.552786 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 3/4] 10.222.0.63 () {62 vars in 1236 bytes} [Thu Dec 3 14:54:29 2020] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:29.568153 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-ee4ed596-bf9d-49dd-b1d8-b0e2e58eb839 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:29.592584 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-ee4ed596-bf9d-49dd-b1d8-b0e2e58eb839 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.033442 Dec 03 14:54:29.593158 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 2/5] 10.222.0.63 () {58 vars in 1183 bytes} [Thu Dec 3 14:54:29 2020] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:32.192096 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-e8051166-51ab-4913-9668-39b1a9b36d26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:32.220428 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 14:54:32.220428 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: warnings.warn(msg) Dec 03 14:54:32.242374 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-e8051166-51ab-4913-9668-39b1a9b36d26 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.136233 Dec 03 14:54:32.242990 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 4/6] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:32 2020] POST /compute/v2.1/flavors => generated 364 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:32.259427 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-163599b3-2995-4806-8eb3-2e72903be976 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:32.266446 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 14:54:32.266446 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: warnings.warn(msg) Dec 03 14:54:32.303136 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-163599b3-2995-4806-8eb3-2e72903be976 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.052695 Dec 03 14:54:32.303753 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 3/7] 10.222.0.63 () {62 vars in 1236 bytes} [Thu Dec 3 14:54:32 2020] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:32.319388 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a1fda104-6587-43e6-bca3-7ccdb5486189 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:32.341707 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a1fda104-6587-43e6-bca3-7ccdb5486189 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030994 Dec 03 14:54:32.342321 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 5/8] 10.222.0.63 () {58 vars in 1183 bytes} [Thu Dec 3 14:54:32 2020] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:34.960009 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-ac691e75-9116-4c7a-8de1-4906ccf6348d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:34.987781 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-ac691e75-9116-4c7a-8de1-4906ccf6348d admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.115530 Dec 03 14:54:34.988323 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 4/9] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:34 2020] POST /compute/v2.1/flavors => generated 364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:35.005163 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-f500cf32-9e22-4cc3-b4a3-c257352cdb10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:35.047170 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-f500cf32-9e22-4cc3-b4a3-c257352cdb10 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050830 Dec 03 14:54:35.047774 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 6/10] 10.222.0.63 () {62 vars in 1236 bytes} [Thu Dec 3 14:54:34 2020] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:35.063929 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-6e0af4e9-0c3c-4adc-b4cc-088c22455283 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:35.084038 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-6e0af4e9-0c3c-4adc-b4cc-088c22455283 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029884 Dec 03 14:54:35.084611 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 5/11] 10.222.0.63 () {58 vars in 1183 bytes} [Thu Dec 3 14:54:35 2020] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:37.691383 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-62f4381f-3aa0-40b4-9768-7d091794251d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:37.720889 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-62f4381f-3aa0-40b4-9768-7d091794251d admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.117520 Dec 03 14:54:37.721497 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 7/12] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:37 2020] POST /compute/v2.1/flavors => generated 364 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:37.738134 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-22491971-727b-4c82-85c9-744bd889fa4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:37.780461 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-22491971-727b-4c82-85c9-744bd889fa4c admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.051828 Dec 03 14:54:37.781099 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 6/13] 10.222.0.63 () {62 vars in 1236 bytes} [Thu Dec 3 14:54:37 2020] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:37.797885 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-0341c050-1904-4bf8-b538-f7c6e0669f4b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:37.818976 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-0341c050-1904-4bf8-b538-f7c6e0669f4b admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031384 Dec 03 14:54:37.819555 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 8/14] 10.222.0.63 () {58 vars in 1183 bytes} [Thu Dec 3 14:54:37 2020] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:40.490253 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-f96703e7-bf31-453f-99dc-faa0287cb0a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:40.518728 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-f96703e7-bf31-453f-99dc-faa0287cb0a3 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.115438 Dec 03 14:54:40.519344 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 7/15] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:40 2020] POST /compute/v2.1/flavors => generated 364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:40.536625 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-6138be7b-ac85-4313-b4be-4f0144e05643 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:40.584377 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-6138be7b-ac85-4313-b4be-4f0144e05643 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.056519 Dec 03 14:54:40.585003 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 9/16] 10.222.0.63 () {62 vars in 1236 bytes} [Thu Dec 3 14:54:40 2020] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:40.600953 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-bbf9cf6b-50be-4a39-a61e-fecdc5d7cf5f admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:40.623216 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-bbf9cf6b-50be-4a39-a61e-fecdc5d7cf5f admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031220 Dec 03 14:54:40.623789 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 8/17] 10.222.0.63 () {58 vars in 1183 bytes} [Thu Dec 3 14:54:40 2020] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:43.198934 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-48dfcb17-353c-4700-8710-4352044ae38a admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:43.218514 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-48dfcb17-353c-4700-8710-4352044ae38a admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.107607 Dec 03 14:54:43.219105 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 10/18] 10.222.0.63 () {58 vars in 1150 bytes} [Thu Dec 3 14:54:43 2020] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 14:54:45.858210 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-9d38dec6-6ab5-41c0-89d3-d64c03b5a9cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:45.885838 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-9d38dec6-6ab5-41c0-89d3-d64c03b5a9cb admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.116173 Dec 03 14:54:45.886468 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 9/19] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:45 2020] POST /compute/v2.1/flavors => generated 362 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:45.903364 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-1114e6b7-1a8c-471a-b61e-f57be4370ec4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:45.943332 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-1114e6b7-1a8c-471a-b61e-f57be4370ec4 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049746 Dec 03 14:54:45.943939 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 11/20] 10.222.0.63 () {62 vars in 1233 bytes} [Thu Dec 3 14:54:45 2020] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:45.959633 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-8c51f3f6-5fd0-4c22-ac0c-4e38b5f57b03 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:45.979797 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-8c51f3f6-5fd0-4c22-ac0c-4e38b5f57b03 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028944 Dec 03 14:54:45.980371 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 10/21] 10.222.0.63 () {58 vars in 1180 bytes} [Thu Dec 3 14:54:45 2020] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:48.590340 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-084fd8f8-82c3-4aec-bb55-6939146ceaac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:48.618160 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-084fd8f8-82c3-4aec-bb55-6939146ceaac admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.116713 Dec 03 14:54:48.619428 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 12/22] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:48 2020] POST /compute/v2.1/flavors => generated 365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:48.638386 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-d6937eda-6f86-4c85-93c6-af2813392f38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:48.679671 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-d6937eda-6f86-4c85-93c6-af2813392f38 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.051074 Dec 03 14:54:48.680286 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 11/23] 10.222.0.63 () {62 vars in 1233 bytes} [Thu Dec 3 14:54:48 2020] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:48.695632 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-060dc006-1cf1-42be-9cdc-f7c40fb9a2b5 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:48.716665 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-060dc006-1cf1-42be-9cdc-f7c40fb9a2b5 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029844 Dec 03 14:54:48.717237 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 13/24] 10.222.0.63 () {58 vars in 1180 bytes} [Thu Dec 3 14:54:48 2020] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:51.348014 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-774017b3-3433-4a24-b770-62329b7bb96f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:51.376929 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-774017b3-3433-4a24-b770-62329b7bb96f admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.116210 Dec 03 14:54:51.377558 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 12/25] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:51 2020] POST /compute/v2.1/flavors => generated 366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:51.393966 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-9143037c-a533-4172-9240-6ea2ce79087c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:51.434877 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-9143037c-a533-4172-9240-6ea2ce79087c admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050202 Dec 03 14:54:51.435485 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 14/26] 10.222.0.63 () {62 vars in 1233 bytes} [Thu Dec 3 14:54:51 2020] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:51.451033 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-330aff43-5c68-4c9a-8fd8-261bdf689620 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:51.471706 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-330aff43-5c68-4c9a-8fd8-261bdf689620 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029963 Dec 03 14:54:51.472281 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 13/27] 10.222.0.63 () {58 vars in 1180 bytes} [Thu Dec 3 14:54:51 2020] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:54.069731 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-b6106f91-7bd0-419f-a9e3-c44433b02855 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:54.100982 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-b6106f91-7bd0-419f-a9e3-c44433b02855 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.117890 Dec 03 14:54:54.101600 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 15/28] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:53 2020] POST /compute/v2.1/flavors => generated 365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:54.118282 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-69c4a341-1df1-4918-b277-c978bc8bb3e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:54.158596 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-69c4a341-1df1-4918-b277-c978bc8bb3e7 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049233 Dec 03 14:54:54.159202 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 14/29] 10.222.0.63 () {62 vars in 1233 bytes} [Thu Dec 3 14:54:54 2020] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:54.175171 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a6412b3b-7b4b-46f8-891d-21b7a6da5993 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:54.196206 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a6412b3b-7b4b-46f8-891d-21b7a6da5993 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030851 Dec 03 14:54:54.196780 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 16/30] 10.222.0.63 () {58 vars in 1180 bytes} [Thu Dec 3 14:54:54 2020] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:56.775094 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-f518b425-8093-4b25-a6ca-7d2a29833421 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:56.802577 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-f518b425-8093-4b25-a6ca-7d2a29833421 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.117945 Dec 03 14:54:56.803196 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 15/31] 10.222.0.63 () {62 vars in 1183 bytes} [Thu Dec 3 14:54:56 2020] POST /compute/v2.1/flavors => generated 368 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:54:56.819591 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-d4478d6e-d522-4701-b702-4c14b3b80d67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:54:56.860202 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-d4478d6e-d522-4701-b702-4c14b3b80d67 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049376 Dec 03 14:54:56.860819 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 17/32] 10.222.0.63 () {62 vars in 1233 bytes} [Thu Dec 3 14:54:56 2020] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:54:56.877152 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-68aa616b-3aa6-4d8c-ba58-2d62e36a224c admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:54:56.898916 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-68aa616b-3aa6-4d8c-ba58-2d62e36a224c admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031840 Dec 03 14:54:56.899511 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 16/33] 10.222.0.63 () {58 vars in 1180 bytes} [Thu Dec 3 14:54:56 2020] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 14:56:09.265394 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-3a37f1bd-1b6a-452f-aeec-e62b4bb6f38b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:09.288707 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-3a37f1bd-1b6a-452f-aeec-e62b4bb6f38b admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.110104 Dec 03 14:56:09.289306 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 18/34] 10.222.0.63 () {58 vars in 1150 bytes} [Thu Dec 3 14:56:09 2020] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 14:56:11.118698 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-68aa616b-3aa6-4d8c-ba58-2d62e36a224c admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:11.120368 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-68aa616b-3aa6-4d8c-ba58-2d62e36a224c admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002202 Dec 03 14:56:11.120818 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 17/35] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:56:11 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:56:11.335365 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-213008b0-0cd4-479a-b0b9-5e71ad5affa2 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:11.350303 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.wsgi [None req-213008b0-0cd4-479a-b0b9-5e71ad5affa2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 03 14:56:11.350940 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-213008b0-0cd4-479a-b0b9-5e71ad5affa2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 14:56:11.351797 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-213008b0-0cd4-479a-b0b9-5e71ad5affa2 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.102939 Dec 03 14:56:11.352353 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 19/36] 10.222.0.63 () {60 vars in 1181 bytes} [Thu Dec 3 14:56:11 2020] GET /compute/v2.1/flavors/42 => generated 75 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 14:56:11.367823 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-7932edea-61d6-47b0-84db-f551859c0214 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:11.399628 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-7932edea-61d6-47b0-84db-f551859c0214 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.040842 Dec 03 14:56:11.400240 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 18/37] 10.222.0.63 () {60 vars in 1201 bytes} [Thu Dec 3 14:56:11 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 14:56:11.416632 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-0995fe0f-32da-4d05-a066-175d7cfc9c55 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:11.438441 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-0995fe0f-32da-4d05-a066-175d7cfc9c55 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031261 Dec 03 14:56:11.439031 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 20/38] 10.222.0.63 () {60 vars in 1201 bytes} [Thu Dec 3 14:56:11 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 14:56:11.454580 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-6c583ec1-6fde-48d8-a350-0c4b216775ec admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:11.469491 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.wsgi [None req-6c583ec1-6fde-48d8-a350-0c4b216775ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 03 14:56:11.470174 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-6c583ec1-6fde-48d8-a350-0c4b216775ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 14:56:11.471844 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-6c583ec1-6fde-48d8-a350-0c4b216775ec admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.026104 Dec 03 14:56:11.472432 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 19/39] 10.222.0.63 () {60 vars in 1181 bytes} [Thu Dec 3 14:56:11 2020] GET /compute/v2.1/flavors/42 => generated 75 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 14:56:13.023531 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-0995fe0f-32da-4d05-a066-175d7cfc9c55 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:13.024613 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-0995fe0f-32da-4d05-a066-175d7cfc9c55 admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Dec 03 14:56:13.025046 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 21/40] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:56:13 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:56:13.242438 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-8f0c38e3-3739-4f83-aa46-623eb8ced211 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:13.255324 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.wsgi [None req-8f0c38e3-3739-4f83-aa46-623eb8ced211 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 03 14:56:13.255954 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-8f0c38e3-3739-4f83-aa46-623eb8ced211 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 14:56:13.256809 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-8f0c38e3-3739-4f83-aa46-623eb8ced211 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.104925 Dec 03 14:56:13.257363 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 20/41] 10.222.0.63 () {60 vars in 1181 bytes} [Thu Dec 3 14:56:13 2020] GET /compute/v2.1/flavors/84 => generated 75 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 14:56:13.272453 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-f82fc177-8ace-4154-82f7-df4b420b837b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:13.297139 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-f82fc177-8ace-4154-82f7-df4b420b837b admin admin] 10.222.0.63 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.033370 Dec 03 14:56:13.297709 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 22/42] 10.222.0.63 () {60 vars in 1201 bytes} [Thu Dec 3 14:56:13 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 14:56:13.317876 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-9dce39ef-3f49-48e5-bfbd-d9a656d61dc5 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:13.342808 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-9dce39ef-3f49-48e5-bfbd-d9a656d61dc5 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.037562 Dec 03 14:56:13.343390 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 21/43] 10.222.0.63 () {60 vars in 1201 bytes} [Thu Dec 3 14:56:13 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 14:56:13.358573 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-c0f23e4c-1a55-4de7-8059-79764548ab57 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:13.371485 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.wsgi [None req-c0f23e4c-1a55-4de7-8059-79764548ab57 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 03 14:56:13.372100 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-c0f23e4c-1a55-4de7-8059-79764548ab57 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 14:56:13.372947 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-c0f23e4c-1a55-4de7-8059-79764548ab57 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.023131 Dec 03 14:56:13.373487 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 23/44] 10.222.0.63 () {60 vars in 1181 bytes} [Thu Dec 3 14:56:13 2020] GET /compute/v2.1/flavors/84 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 14:56:14.972789 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-9dce39ef-3f49-48e5-bfbd-d9a656d61dc5 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:14.973850 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-9dce39ef-3f49-48e5-bfbd-d9a656d61dc5 admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Dec 03 14:56:14.974328 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 22/45] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:56:14 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:56:15.193173 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-93a47ae1-23ca-4072-8e1a-335c788484e3 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:15.206759 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.wsgi [None req-93a47ae1-23ca-4072-8e1a-335c788484e3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 03 14:56:15.207369 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-93a47ae1-23ca-4072-8e1a-335c788484e3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 14:56:15.208213 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-93a47ae1-23ca-4072-8e1a-335c788484e3 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.104626 Dec 03 14:56:15.208763 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 24/46] 10.222.0.63 () {60 vars in 1184 bytes} [Thu Dec 3 14:56:15 2020] GET /compute/v2.1/flavors/451 => generated 76 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 14:56:15.225264 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-f8ae1507-0e86-4dad-bf5e-09825a1475f3 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:15.247783 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-f8ae1507-0e86-4dad-bf5e-09825a1475f3 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.032702 Dec 03 14:56:15.248354 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 23/47] 10.222.0.63 () {60 vars in 1201 bytes} [Thu Dec 3 14:56:15 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 14:56:15.264324 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:15.285968 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] 10.222.0.63 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.030199 Dec 03 14:56:15.286555 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 25/48] 10.222.0.63 () {60 vars in 1201 bytes} [Thu Dec 3 14:56:15 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 14:56:15.302861 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-0364fe5d-40a9-4494-84fc-71ca590d10af admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:15.316470 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.wsgi [None req-0364fe5d-40a9-4494-84fc-71ca590d10af admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 03 14:56:15.317149 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-0364fe5d-40a9-4494-84fc-71ca590d10af admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 14:56:15.318005 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-0364fe5d-40a9-4494-84fc-71ca590d10af admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.025099 Dec 03 14:56:15.318555 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 24/49] 10.222.0.63 () {60 vars in 1184 bytes} [Thu Dec 3 14:56:15 2020] GET /compute/v2.1/flavors/451 => generated 76 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 14:56:16.893244 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:16.894331 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Dec 03 14:56:16.894760 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 26/50] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:56:16 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:56:17.112181 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-d95d3a86-7a93-4524-86f4-2b514ba5dad3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:56:17.146255 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-d95d3a86-7a93-4524-86f4-2b514ba5dad3 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.122136 Dec 03 14:56:17.146862 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 25/51] 10.222.0.63 () {64 vars in 1226 bytes} [Thu Dec 3 14:56:17 2020] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 14:56:18.696609 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:18.697689 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Dec 03 14:56:18.698154 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 27/52] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:56:18 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:56:18.926360 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-f7369d94-ec04-42e4-99bf-8a0ee50a4db5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:56:18.960278 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-f7369d94-ec04-42e4-99bf-8a0ee50a4db5 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.132425 Dec 03 14:56:18.960866 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 26/53] 10.222.0.63 () {64 vars in 1226 bytes} [Thu Dec 3 14:56:18 2020] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 14:56:20.500644 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:20.501721 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Dec 03 14:56:20.502461 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 28/54] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:56:20 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:56:20.721299 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-bcc301f0-ec21-407e-a449-e8bddc7bde0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:56:20.755151 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-bcc301f0-ec21-407e-a449-e8bddc7bde0a admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.123495 Dec 03 14:56:20.755755 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 27/55] 10.222.0.63 () {64 vars in 1226 bytes} [Thu Dec 3 14:56:20 2020] POST /compute/v2.1/flavors => generated 407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 14:56:22.326363 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:22.327439 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Dec 03 14:56:22.327915 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 29/56] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:56:22 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:56:22.558372 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-30e1aa13-f99e-4268-8909-0528fc75b7a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 14:56:22.592521 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-30e1aa13-f99e-4268-8909-0528fc75b7a5 admin admin] 10.222.0.63 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.122905 Dec 03 14:56:22.593119 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 28/57] 10.222.0.63 () {64 vars in 1226 bytes} [Thu Dec 3 14:56:22 2020] POST /compute/v2.1/flavors => generated 409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 14:56:24.204454 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:24.206254 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Dec 03 14:56:24.206688 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 30/58] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:56:24 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:56:24.418888 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-ed7c2a6d-ca4c-474c-ac82-0a818b4ba0f6 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:56:24.456248 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-ed7c2a6d-ca4c-474c-ac82-0a818b4ba0f6 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.122794 Dec 03 14:56:24.456835 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 29/59] 10.222.0.63 () {60 vars in 1193 bytes} [Thu Dec 3 14:56:24 2020] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 14:57:15.482579 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:57:15.483649 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a0383293-277e-459c-bdb8-5ee893c3aa4b admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Dec 03 14:57:15.484080 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 31/60] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 14:57:15 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 14:57:15.708079 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:57:15.741439 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] 10.222.0.63 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.123144 Dec 03 14:57:15.742051 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 30/61] 10.222.0.63 () {60 vars in 1193 bytes} [Thu Dec 3 14:57:15 2020] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 14:58:32.105195 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-6a5d8c81-cbfc-4609-8ff0-a7e2fc0e0c08 tempest-verify_tempest_config-1238417722 tempest-verify_tempest_config-1238417722] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 14:58:32.112781 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-6a5d8c81-cbfc-4609-8ff0-a7e2fc0e0c08 tempest-verify_tempest_config-1238417722 tempest-verify_tempest_config-1238417722] 10.222.0.63 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.160974 Dec 03 14:58:32.113375 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 32/62] 10.222.0.63 () {58 vars in 1124 bytes} [Thu Dec 3 14:58:31 2020] GET /compute/v2.1/extensions => generated 22700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:00:10.388566 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:00:10.389633 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Dec 03 15:00:10.390090 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 31/63] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 15:00:10 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:00:10.694329 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-f490f7dc-ca1f-4499-b992-8519d5ed143c admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:00:10.700406 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:00:10.700406 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: warnings.warn(msg) Dec 03 15:00:10.702024 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-f490f7dc-ca1f-4499-b992-8519d5ed143c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:00:10.702519 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-f490f7dc-ca1f-4499-b992-8519d5ed143c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:00:10.703364 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-f490f7dc-ca1f-4499-b992-8519d5ed143c admin admin] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:00:10.703835 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-f490f7dc-ca1f-4499-b992-8519d5ed143c admin admin] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:00:10.739138 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-f490f7dc-ca1f-4499-b992-8519d5ed143c admin admin] 10.222.0.63 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.210633 Dec 03 15:00:10.739743 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 33/64] 10.222.0.63 () {60 vars in 1184 bytes} [Thu Dec 3 15:00:10 2020] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:00:12.326552 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:00:12.327634 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Dec 03 15:00:12.328070 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 32/65] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 15:00:12 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:00:12.551067 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a9c3a773-e84a-4b21-959b-692fe534b1b4 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:00:12.557410 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:00:12.557410 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: warnings.warn(msg) Dec 03 15:00:12.559026 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-a9c3a773-e84a-4b21-959b-692fe534b1b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:00:12.559519 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-a9c3a773-e84a-4b21-959b-692fe534b1b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:00:12.560362 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-a9c3a773-e84a-4b21-959b-692fe534b1b4 admin admin] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:00:12.560840 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-a9c3a773-e84a-4b21-959b-692fe534b1b4 admin admin] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:00:12.586482 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a9c3a773-e84a-4b21-959b-692fe534b1b4 admin admin] 10.222.0.63 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.122657 Dec 03 15:00:12.587069 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 34/66] 10.222.0.63 () {60 vars in 1184 bytes} [Thu Dec 3 15:00:12 2020] GET /compute/v2.1/os-services => generated 791 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:00:24.565170 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:00:24.566293 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Dec 03 15:00:24.566727 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 33/67] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 15:00:24 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:00:24.786638 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-93dc0c13-eb07-4016-8ccd-5e080edcf728 admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:00:24.792651 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:00:24.792651 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: warnings.warn(msg) Dec 03 15:00:24.794248 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-93dc0c13-eb07-4016-8ccd-5e080edcf728 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:00:24.794741 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-93dc0c13-eb07-4016-8ccd-5e080edcf728 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:00:24.795580 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-93dc0c13-eb07-4016-8ccd-5e080edcf728 admin admin] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:00:24.796053 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-93dc0c13-eb07-4016-8ccd-5e080edcf728 admin admin] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:00:24.829945 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-93dc0c13-eb07-4016-8ccd-5e080edcf728 admin admin] 10.222.0.63 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.131446 Dec 03 15:00:24.830549 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 35/68] 10.222.0.63 () {60 vars in 1184 bytes} [Thu Dec 3 15:00:24 2020] GET /compute/v2.1/os-services => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:00:26.410149 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] Calling method '>' {{(pid=79704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:00:26.411233 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-81625443-c488-4dea-bf88-0dd2da024750 admin admin] 10.222.0.63 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Dec 03 15:00:26.411670 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79704|app: 0|req: 34/69] 10.222.0.63 () {56 vars in 1065 bytes} [Thu Dec 3 15:00:26 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:00:26.631593 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG nova.api.openstack.wsgi [None req-a43dcb04-911a-4497-a2ef-ae7fdce7325b admin admin] Calling method '>' {{(pid=79703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:00:26.638132 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:00:26.638132 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: warnings.warn(msg) Dec 03 15:00:26.640094 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-a43dcb04-911a-4497-a2ef-ae7fdce7325b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:00:26.640588 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-a43dcb04-911a-4497-a2ef-ae7fdce7325b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:00:26.642477 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-a43dcb04-911a-4497-a2ef-ae7fdce7325b admin admin] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:00:26.642477 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: DEBUG oslo_concurrency.lockutils [None req-a43dcb04-911a-4497-a2ef-ae7fdce7325b admin admin] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79703) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:00:26.670503 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: INFO nova.api.openstack.requestlog [None req-a43dcb04-911a-4497-a2ef-ae7fdce7325b admin admin] 10.222.0.63 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.129371 Dec 03 15:00:26.671095 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: [pid: 79703|app: 0|req: 36/70] 10.222.0.63 () {60 vars in 1184 bytes} [Thu Dec 3 15:00:26 2020] GET /compute/v2.1/os-services => generated 1035 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:01:24.198960 dv-cinder-757908-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 03 15:01:24.199447 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: Thu Dec 3 15:01:24 2020 - graceful shutdown triggered... Dec 03 15:01:24.199894 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: Gracefully killing worker 1 (pid: 79703)... Dec 03 15:01:24.200020 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: Gracefully killing worker 2 (pid: 79704)... Dec 03 15:01:25.200213 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: worker 1 buried after 1 seconds Dec 03 15:01:25.200213 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: worker 2 buried after 1 seconds Dec 03 15:01:25.200213 dv-cinder-757908-3-iscsi devstack@n-api.service[79702]: goodbye to uWSGI. Dec 03 15:01:25.201935 dv-cinder-757908-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 03 15:01:25.204054 dv-cinder-757908-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 03 15:01:25.212111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: *** Starting uWSGI 2.0.15-debian (64bit) on [Thu Dec 3 15:01:25 2020] *** Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: nodename: dv-cinder-757908-3-iscsi Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: machine: x86_64 Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: clock source: unix Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: pcre jit disabled Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: detected number of CPU cores: 4 Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: current working directory: / Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: detected binary path: /usr/bin/uwsgi-core Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: dropping root privileges as early as possible Dec 03 15:01:25.214108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: your processes number limit is 47843 Dec 03 15:01:25.215205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: your memory page size is 4096 bytes Dec 03 15:01:25.215205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: detected max file descriptor number: 2048 Dec 03 15:01:25.215205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: lock engine: pthread robust mutexes Dec 03 15:01:25.215205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: thunder lock: enabled Dec 03 15:01:25.215205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 03 15:01:25.215205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: dropping root privileges after socket binding Dec 03 15:01:25.215205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Dec 03 15:01:25.261014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Python main interpreter initialized at 0x55a3b878e9c0 Dec 03 15:01:25.261014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: dropping root privileges after plugin initialization Dec 03 15:01:25.261014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: python threads support enabled Dec 03 15:01:25.261014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: your server socket listen backlog is limited to 100 connections Dec 03 15:01:25.261014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: your mercy for graceful operations on workers is 90 seconds Dec 03 15:01:25.261575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: mapped 402621 bytes (393 KB) for 2 cores Dec 03 15:01:25.261575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: *** Operational MODE: preforking *** Dec 03 15:01:25.261752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: dropping root privileges after application loading Dec 03 15:01:25.261752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: *** uWSGI is running in multiple interpreter mode *** Dec 03 15:01:25.261752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: spawned uWSGI master process (pid: 94371) Dec 03 15:01:25.261837 dv-cinder-757908-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 03 15:01:25.262129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: spawned uWSGI worker 1 (pid: 94373, cores: 1) Dec 03 15:01:25.262475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: spawned uWSGI worker 2 (pid: 94374, cores: 1) Dec 03 15:01:25.262580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 03 15:01:29.863556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 03 15:01:29.864202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 03 15:01:29.864707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 03 15:01:29.865043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 03 15:01:29.865466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 03 15:01:29.865926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 03 15:01:29.866226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 03 15:01:29.866663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 03 15:01:29.866790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.867040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.867156 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 03 15:01:29.867387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 03 15:01:29.867499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.867761 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.867880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.868125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.868250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.868486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.868609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.868861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.868991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.869216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.869334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.869581 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.869706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.869961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.870080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.870319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.870417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.870618 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.870726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.870977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.871100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.871350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-757908-3-iscsi {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.871454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.871651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.871771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.872015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.872118 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.872372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.872480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-757908-3-iscsi {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.872736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.872844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.873086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.873191 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.873437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.873551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.873776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.873885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.874156 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.874466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.874655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.875300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.875634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.875755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.876087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.876261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.876480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.876599 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.876841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.876955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.877194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.877307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.877561 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.877670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.877934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.878054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.878310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.878436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.878663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.878772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.879011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.879114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-757908-3-iscsi {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.879375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.879476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.879726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.879828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.880082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.880240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-757908-3-iscsi {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.880442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.880551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.880799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.880907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.881163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.881272 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.881579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.881707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.881983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.882090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.882340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.882453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.882706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.882820 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.883067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.883177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.883412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.883520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.883772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.883881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.884117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.884218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.884468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.884570 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.884818 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.884926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.885158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.885260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.885503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.885652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.885846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.885970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.886166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.886283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.886517 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.886625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.886881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.886992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.887173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.887274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.887526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.887634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.887848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.887959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.888136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.888238 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.888502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.888619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.888850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.888952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.889141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.889244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.889511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.889614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.889853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.890008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.890318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.890434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.890690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.890894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.891038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.891149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.891390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.891512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.891738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.891846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.892083 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.892273 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.892442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.892555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.892789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.892896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.893130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.893237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.893495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.893605 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.893858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.894028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.63 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.894237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.63 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.894345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.894588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.894697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.894978 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.895080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.63 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.895306 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.63 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.895413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.895659 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.895773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.896016 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.896128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.896434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.896548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.896739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.896851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.897087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.897199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.897439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.897541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.897785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.897899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.898166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.898269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.898516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.898650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.898804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.898906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.899147 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.899257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.899493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.899643 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.899808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.899916 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.900154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.900262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.900495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.900629 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.900842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.900938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.901182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.901290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.901527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.901649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.901863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.902026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.902230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.902365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.902572 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.902687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.902916 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.903023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.903257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.903359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.903600 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.903709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.903937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.904038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.904281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.904383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.904633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.904746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.904985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.905093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.905328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.905435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.906205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.906360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.906620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.906785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.906894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.907175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.907289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.907534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.907636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.907884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.907986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.908232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.908342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.908575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.908704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.908920 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.909029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.909267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.909377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.909607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.909715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.909988 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.910093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.910344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.910462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.910681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.910815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.911027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.911129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.911373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.911487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.911715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.911820 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.912059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.912160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.912406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.912516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.912712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.912814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.913055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.913163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.913398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.913508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.913734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.913842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.914114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.914231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.914446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.914555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.914787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.914895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.915134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.915242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.915479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.915588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.915822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.915925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.916169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.916277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.916534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.916639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.916897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.917000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.917233 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.917364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.917582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.917706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.917986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.918103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 15:01:29.918372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.918486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.918747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.918892 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.919110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.919212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.919467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.919580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.919824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.919935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.920199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.920300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.920555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.920658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.920906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.921014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.921253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.921413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.922238 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.922413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.922785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.922908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.923128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.923231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.923487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.923589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.923849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.923968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.924211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.924323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.924561 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.924670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.924924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.925032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.925282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.925397 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.925642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.925744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.926019 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.926138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.926388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.926521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.926773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.926882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.927124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.927239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.927475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.927583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.927827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.927929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.928452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.928560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.928816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.928951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.929180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.929288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.929530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.929633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.929878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.930007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.930263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.930370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.930622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.930735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.930984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.931093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.931339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.931447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.931684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.931797 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.932033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.932135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.932384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.932496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.932737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.932847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.933082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.933184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.933435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.933536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.933786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.933895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.934170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.934274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.934524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.934625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.934872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.934985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.935229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.935333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.935579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.935681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.935924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.936026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.936286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.936387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.936638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.936741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.937013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.937167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.937418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.937599 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.937785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.938059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.938245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.938353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.938504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.938608 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.938846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.938955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.939197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.939307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.939543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.939645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.939889 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.940003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.940244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.940346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.940591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.940693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.940945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.941055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.941294 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.941399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.941644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.941752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.942030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.942153 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.942409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.942520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.942753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.942904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.943103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.943277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.943466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.943574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.943828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.943936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.944175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.944288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.944528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.944636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.944876 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.944984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.945224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.945326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.945566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.945668 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.945924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.946029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.946284 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.946393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.946630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.946758 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.946977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.947121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.947322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.947440 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.947665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.947766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.948016 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.948119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.948359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.948463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.948702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.948810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.949038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.949175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.949386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.949488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.949734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.949835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.950127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.950244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.950481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.950583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.950835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.950937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.951194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.951333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.951557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.951660 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.951902 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.952004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.952251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.952359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.952659 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.952777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.953074 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.953188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.953447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.953643 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.953772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.953946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.954142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.954292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.954484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.954636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.954842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.955024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.955193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.955367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.955530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.955667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.955807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.955958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.956163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.956311 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.956532 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.956681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.956873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.956997 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.957227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.957366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.957580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.957725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.957946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.958086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.958279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.958417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.958625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.958766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.958973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.959122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.959298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.959449 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.959647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.959785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.959990 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.960136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.960328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.960480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.960683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.960823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.961025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.961179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.961369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.961463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.961708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.961793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.962089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.962188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.962449 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.962545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.962797 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.962906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.963138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.963241 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.963497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.963609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.963833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.963935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.964181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.964283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.964549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.964652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.964891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.964999 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.965240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.965341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.965584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.965686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.965928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.966042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.966339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.966448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.966687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.966795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.967032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.967141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.967375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.967483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.967731 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.967839 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.968082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.968698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.968985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.969097 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.969389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.969480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.969747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.969879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.970120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.970235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.970474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.970583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.970824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.970932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.971173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.971287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.971528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.971630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.971882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.971983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.972232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.972345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.972592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.972724 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.972934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.973051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.973286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.973398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.973630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.973739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.974003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.974120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.974362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.974465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.974713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.974820 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.975072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.975415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.975524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.975766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.975874 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.976127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.976234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.976491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.976828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.976932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.977200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.977307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.977560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.977663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.977947 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.978052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.978306 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.978409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.978655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.978772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.979013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.979122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.979364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.979499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.979712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.979824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.980058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.980160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.980400 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.980509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.980747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.980857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.981086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.981188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.981436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.981538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.981775 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.981888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.982146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.982275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.982488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.982575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.982837 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.982950 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.983178 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.983305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.983520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.983622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.984418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.984538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.984772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.985010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.985223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.985406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.985594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.985766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.985983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.986180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.986336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.986540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.986654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.986921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.987030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.987286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.987394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.987643 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.987753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.987997 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.988099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.988350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.988457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.988750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.988860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.989092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.989194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.989466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.989596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.989814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.989936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.990190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.990304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.990545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.990646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.990897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.991006 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.991252 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.991353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.991599 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.991711 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.991945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.992048 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.992297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.992432 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.992635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.992750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.992989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.993097 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.993329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.993436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.993678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.993791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.994046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.994162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.994396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.994498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.994732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.994842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.995077 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.995180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.995422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.995524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.995768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.995878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.996119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.996221 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.996465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.996568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.996815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.996924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.997160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.997261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.997508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.997610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.997856 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.998014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.998235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.998337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.998589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.998697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.998941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.999044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.999286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.999389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.999703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:29.999808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.000506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.000628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.000628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.000770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.000971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.001066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.001276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.001364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.001470 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.001624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.001716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.001815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.002168 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.002297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.002450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.002542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.002793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.002920 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.003160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.003276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.003503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.003612 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.003842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.003957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.004185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.004294 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.004523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.004632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.004889 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.005004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.005239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.005342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.005583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.005692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.005975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.006098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.006310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.006412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.006675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.006783 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.007032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.007142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.007372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.007493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.007735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.007877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.008092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.008190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.008446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.008549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.008795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.008904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.009140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.009249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.009497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.009604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.009844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.009961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.010228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.010333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.010574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.010677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.010925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.011027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.011290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.011392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.011637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.011738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.011989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.012097 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.012342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.012444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.012692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.012794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.013051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.013200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.013396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.013493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.013743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.013826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.014121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.014244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.014470 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.014579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.014820 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.014928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.015712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.015854 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.016424 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.016546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.016546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.016694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.016918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.017051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.017283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.017385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.017644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.017753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.018020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.018126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.018374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.018480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.018723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.018826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.019069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.019174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.019424 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.019526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.019771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.019906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.020125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.020453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.020562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.020804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.020913 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.021159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.021315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.021500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.021603 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.021851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.022223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.022335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.022582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.022683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.022939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.023048 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.023284 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.023394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.023639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.023766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.023999 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.024109 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.024367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.024481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.024737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.024846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.025081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.025183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.025431 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.025544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.025787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.025896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.026193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.026296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.026544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.026654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.026900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.027002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.027250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.027352 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.027611 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.027719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.027952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.028061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.028317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.028464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.028670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.028782 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.029024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.029133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.029400 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.029502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.029752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.029861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.030151 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.030258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.030568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.030693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.031509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.031621 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.031886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.031994 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.032257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.032370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.032606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.032707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.032964 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.033116 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.033319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.033430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.033670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.033773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.034070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.034176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.034444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.034555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.034800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.034903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.035154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.035254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.035501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.035611 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.035867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.035969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.036235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.036337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.036588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.036697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.036945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.037047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.037304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.037406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.037679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.037832 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.038081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.038185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.038447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.038593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.038810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.038912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.039185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.039292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.039535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.039644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.039885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.039994 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.040242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.040387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.040590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.040699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.040940 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.041049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.041313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.041420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.041657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.041771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.042030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.042145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.042388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.042491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.042733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.042848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.043073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.043200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.043420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.043522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.043771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.043881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.044112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.044220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.044458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.044567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.044810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.044981 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.045160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.045262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.045520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.045634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.045863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.046009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.046256 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.046433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.046750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.046859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.047258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.047383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.047483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.047585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.047782 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.047934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.048178 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.048288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.048527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.048656 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.048877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.048979 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.049229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.049358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.049584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.049686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.049942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.050058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.050341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.050472 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.050704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.050813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.051056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.051170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.051421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.051523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.051772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.051883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.052115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.052225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.052463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.052598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.052815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.052925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.053406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.053562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.053755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.053882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.054131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.054250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.054474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.054586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.054815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.054923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.055158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.055275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.055493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.055603 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.055837 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.055946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.056182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.056285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.056525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.056635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.056877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.056986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.057216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.057325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.057562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.057671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.057925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.058041 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.058305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.058409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.058644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.058746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.058991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.059099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.059342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.059452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.059695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.059797 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.060061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.060171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.060415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.060546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.060785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.060899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.061144 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.061321 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.061497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.061601 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.061856 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.062023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.062289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.062452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.062644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.062736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.063015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.063113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.068855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069876 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.069876 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.070941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.071944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072731 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.072937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.073899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074547 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074656 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.074962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075565 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075760 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.075965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076669 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.076959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.077122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.077323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.077486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.078438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.078675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.078794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.079049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.079198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.079415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.079740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.079873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.080099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.080203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.080479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.080614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.080849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.080953 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.081211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.081321 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.081569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.081673 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.082024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.082242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.082359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.082605 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.082716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.082963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.083073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.083316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.083434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.083667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.083770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.084013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.084115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.084364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.084491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.084714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.084826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.085053 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.085155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.085395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.085563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.085738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.085847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.086467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.086589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.086699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.086798 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.086896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.087113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.087217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.087455 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.087571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.087822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.087925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.088176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.088286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.088528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.088810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.088915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.089219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.089350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.089568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.089679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.089940 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.090088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.090322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.090425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.090666 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.090781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.091014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.091123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.091367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.091469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.091714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.091829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.092052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.092181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.092404 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.092513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.092754 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.092865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.093110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.093250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.094174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.094384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.094527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.094671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.094879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.094992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.095233 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.095347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.095594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.095724 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.095951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.096064 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.096291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.096401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.096639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.096748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.096985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.097088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.097325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.097427 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.097676 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.097780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.098066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.098252 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.098417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.098571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.098757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.098861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.099100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.099226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.099439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.099575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.099789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.099901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.100137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.100240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.100481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.100591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.100986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.101392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.101772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.101931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.102205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.102329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.102588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.102691 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.102920 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.103026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.103274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.103380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.103639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.103941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.104042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.104368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.104504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.104904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.105017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.105102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.105185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.105363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.105469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.105766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.105878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.106202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.106299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.106571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.106687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.106951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.107361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.107474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.107812 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.107919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.108172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.108285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.108527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.108686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.108923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.109046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.109331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.109435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.109765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.109894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.110095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.110209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.110444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.110554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.110800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.110941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.111153 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.111293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.111514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.111619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.111871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.111975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.112220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.112345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.112575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.112731 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.112926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.113031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.113273 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.113384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.113625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.113728 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.113995 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.114115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.114360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.114466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.114730 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.114864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.115085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.115192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.115435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.115544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.115794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.115905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.116156 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.116260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.116514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.116624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.116875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.116986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.117234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.117344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.117600 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.117703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.118014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.118132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.118380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.118484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.118735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.118845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.119076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.119239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.119429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.119601 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.119777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.119970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.120131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.120358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.120527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.120720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.120917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.121103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.121280 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.121500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.121650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.121883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.122121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.122389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.122556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.122974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.123339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.123509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.123702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.124090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.124503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.125098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.125433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.125737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.126014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.126208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.126495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.126655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.126902 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.127108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.127392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.127545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.127755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.127879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.128142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.128272 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.128507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.128640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.128952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.129096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.129211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.129432 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.129625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.129814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.130829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.131011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.131145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.131263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.131380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.131483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.131581 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.131664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.131815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.132030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.132208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.132388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.132594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.132773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.133034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.133150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.133395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.133517 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.133773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.133894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.134157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.134283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.134512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.134617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.134870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.134976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.135255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.135631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.135748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.135982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.136086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.136357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.136461 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.136719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.136824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.137086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.137201 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.137451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.137561 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.137806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.137945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.138217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.138329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.138572 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.138681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.138933 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.139082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.139289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.139398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.139644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.139793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.140004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.140670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.140885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.141034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.141335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.141712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.142597 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.142597 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.142807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.142925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.143049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.143164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.143271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.143376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.143475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.143580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.143684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.143943 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.144059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.144226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94373) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 03 15:01:30.144373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.144710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.145090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.145701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.146106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.146523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.146873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.147244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.147620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.147990 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.148358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.148732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.149106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.149496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.149879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.150291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.150683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.151097 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.151467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.152055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.152447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 15:01:30.152748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94374) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 03 15:01:30.183543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_db.sqlalchemy.engines [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94373) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 15:01:30.192722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_db.sqlalchemy.engines [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94374) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 15:01:30.446079 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.context [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c87cfc1d-53de-458d-8ab1-34bf80d29b3b(cell1) {{(pid=94373) load_cells /opt/stack/nova/nova/context.py:467}} Dec 03 15:01:30.453870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:01:30.455739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:01:30.456619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:01:30.458808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:01:30.459326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.context [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c87cfc1d-53de-458d-8ab1-34bf80d29b3b(cell1) {{(pid=94374) load_cells /opt/stack/nova/nova/context.py:467}} Dec 03 15:01:30.466855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:01:30.468903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:01:30.469957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:01:30.472695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:01:30.485983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_db.sqlalchemy.engines [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94373) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 15:01:30.497081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_db.sqlalchemy.engines [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94373) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 15:01:30.499011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_db.sqlalchemy.engines [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94374) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 15:01:30.500477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_db.sqlalchemy.engines [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94374) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 15:01:30.525288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_db.sqlalchemy.engines [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94373) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 15:01:30.535051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_db.sqlalchemy.engines [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94374) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 15:01:30.699821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Loading Gnome Dec 03 15:01:30.700572 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Loading Gnome Dec 03 15:01:30.723123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Loading Google Dec 03 15:01:30.726522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Loading Windows (alt) Dec 03 15:01:30.730912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Loading Google Dec 03 15:01:30.731473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Loading file Dec 03 15:01:30.732607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Loading keyczar Dec 03 15:01:30.733073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Loading multi Dec 03 15:01:30.734658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Loading pyfs Dec 03 15:01:30.735567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Loading Windows (alt) Dec 03 15:01:30.740574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Loading file Dec 03 15:01:30.741882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Loading keyczar Dec 03 15:01:30.742372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Loading multi Dec 03 15:01:30.743289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO keyring.backend [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Loading pyfs Dec 03 15:01:31.030392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WARNING keystonemiddleware.auth_token [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 15:01:31.036747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WARNING keystonemiddleware.auth_token [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 15:01:31.038402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WARNING keystonemiddleware.auth_token [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 15:01:31.044062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WARNING keystonemiddleware.auth_token [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 15:01:31.377518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WARNING keystonemiddleware.auth_token [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 15:01:31.383237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WARNING keystonemiddleware.auth_token [None req-f35d6d51-9734-4d68-a841-99bfdaecb889 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 15:01:31.385111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WARNING keystonemiddleware.auth_token [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 15:01:31.388823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3b878e9c0 pid: 94373 (default app) Dec 03 15:01:31.391172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WARNING keystonemiddleware.auth_token [None req-74d54445-0a07-48df-af20-27dcd68be446 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 15:01:31.396842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3b878e9c0 pid: 94374 (default app) Dec 03 15:02:10.113487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7c3b1963-bfc1-4e35-afef-b341f74ea18e tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] Action: 'create', calling method: .version_select at 0x7fd5f74cd378>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-970594078", "metadata": {"Type": "work"}}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:10.851717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-46200181-a113-4c3f-a8d4-4bce495fee08 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Action: 'create', calling method: .version_select at 0x7fd5f74cb378>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-60440761"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:12.226405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7c3b1963-bfc1-4e35-afef-b341f74ea18e tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] 10.222.0.63 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.153254 Dec 03 15:02:12.227237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 1/1] 10.222.0.63 () {60 vars in 1146 bytes} [Thu Dec 3 15:02:08 2020] POST /compute/v2.1/os-volumes => generated 352 bytes in 4156 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 03 15:02:12.253540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5b947329-ad75-4b83-a019-b7901ba0e9a3 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f74cdb70>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:12.299993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-46200181-a113-4c3f-a8d4-4bce495fee08 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.277718 Dec 03 15:02:12.301315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 1/2] 10.222.0.63 () {60 vars in 1145 bytes} [Thu Dec 3 15:02:09 2020] POST /compute/v2.1/os-volumes => generated 343 bytes in 3281 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 03 15:02:12.319688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7dd70dbb-39b3-4c97-bf0f-3ea9464f0792 tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] Calling method '.version_select at 0x7fd5f74cbb70>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:12.409326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5b947329-ad75-4b83-a019-b7901ba0e9a3 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes/55792238-a276-47a9-8118-60e1f45bfc62" status: 200 len: 350 microversion: 2.1 time: 0.173105 Dec 03 15:02:12.410664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 2/3] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:12 2020] GET /compute/v2.1/os-volumes/55792238-a276-47a9-8118-60e1f45bfc62 => generated 350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:12.427152 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-185d2978-5a99-4144-a5bb-7d6d3c4adaf3 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74cdbf8>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:12.526517 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7dd70dbb-39b3-4c97-bf0f-3ea9464f0792 tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] 10.222.0.63 "GET /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240" status: 200 len: 353 microversion: 2.1 time: 0.223435 Dec 03 15:02:12.527116 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 2/4] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:12 2020] GET /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240 => generated 353 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:12.545075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0a672856-6807-40f1-af98-fa298fcb08a7 tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] Calling method '.version_select at 0x7fd5f74a4bf8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:13.324942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-185d2978-5a99-4144-a5bb-7d6d3c4adaf3 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765" status: 200 len: 344 microversion: 2.1 time: 0.912851 Dec 03 15:02:13.325895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 3/5] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:12 2020] GET /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765 => generated 344 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:13.355453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-96a50c2a-d775-4f5a-b7e1-1dd99dd643b3 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Action: 'create', calling method: .version_select at 0x7fd5f74a9d90>, body: {"snapshot": {"volume_id": "b076be95-b8f2-48a3-8ce3-8c6382968765", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2123342767"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:13.505414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0a672856-6807-40f1-af98-fa298fcb08a7 tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] 10.222.0.63 "GET /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240" status: 200 len: 353 microversion: 2.1 time: 0.969203 Dec 03 15:02:13.506056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 3/6] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:12 2020] GET /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240 => generated 353 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:13.535719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f3b1b1fd-5c0e-4bd8-b1d1-dff69502f115 tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] Calling method '.version_select at 0x7fd5f74a4f28>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:13.746605 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f3b1b1fd-5c0e-4bd8-b1d1-dff69502f115 tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] 10.222.0.63 "DELETE /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240" status: 202 len: 0 microversion: 2.1 time: 0.221240 Dec 03 15:02:13.747507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 4/7] 10.222.0.63 () {58 vars in 1238 bytes} [Thu Dec 3 15:02:13 2020] DELETE /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:02:13.778563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4d32c990-b908-4195-93e6-a088975a4485 tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] Calling method '.version_select at 0x7fd5f74450d0>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:14.011700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4d32c990-b908-4195-93e6-a088975a4485 tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] 10.222.0.63 "GET /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240" status: 200 len: 352 microversion: 2.1 time: 0.258334 Dec 03 15:02:14.012491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 5/8] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:13 2020] GET /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240 => generated 352 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:14.105103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-96a50c2a-d775-4f5a-b7e1-1dd99dd643b3 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.770229 Dec 03 15:02:14.106179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 4/9] 10.222.0.63 () {60 vars in 1152 bytes} [Thu Dec 3 15:02:13 2020] POST /compute/v2.1/os-snapshots => generated 287 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:14.127371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8a1681d6-7f9f-4f3d-ab08-3ee5183ba139 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f7401488>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:14.196171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-723226376", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "237dead0-62cc-46b7-b149-d9cbbf320fb2"}]}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:14.226585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8a1681d6-7f9f-4f3d-ab08-3ee5183ba139 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0" status: 200 len: 287 microversion: 2.1 time: 0.114370 Dec 03 15:02:14.227462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 5/10] 10.222.0.63 () {58 vars in 1241 bytes} [Thu Dec 3 15:02:14 2020] GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0 => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:02:14.243320 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2d15cc61-af22-45c4-bceb-38e8508f8b2b tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74a9c80>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:14.355290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2d15cc61-af22-45c4-bceb-38e8508f8b2b tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.121432 Dec 03 15:02:14.356726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 6/11] 10.222.0.63 () {58 vars in 1130 bytes} [Thu Dec 3 15:02:14 2020] GET /compute/v2.1/os-snapshots => generated 290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:02:14.376948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-24a7d917-0948-4322-856b-1af2c1b5cde1 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74012f0>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:14.382052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] validate_networks() for [('237dead0-62cc-46b7-b149-d9cbbf320fb2', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:02:14.439505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-24a7d917-0948-4322-856b-1af2c1b5cde1 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0" status: 200 len: 287 microversion: 2.1 time: 0.075013 Dec 03 15:02:14.440314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 7/12] 10.222.0.63 () {58 vars in 1241 bytes} [Thu Dec 3 15:02:14 2020] GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:14.737941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9030a046-d146-4aa9-9b66-8ef510c401d5 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f7401620>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:14.985247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9030a046-d146-4aa9-9b66-8ef510c401d5 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes/763691f9-3b71-4c79-9e70-3a94081a5e35" status: 200 len: 351 microversion: 2.1 time: 0.261424 Dec 03 15:02:14.986340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 8/13] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:14 2020] GET /compute/v2.1/os-volumes/763691f9-3b71-4c79-9e70-3a94081a5e35 => generated 351 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:15.037580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b4633b78-6399-4d38-9160-83166c0eb08a tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] Calling method '.version_select at 0x7fd5f74cdbf8>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:15.333566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-b4633b78-6399-4d38-9160-83166c0eb08a tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] HTTP exception thrown: Volume ef98bdbf-ae16-4f33-820c-8c434bdfc240 could not be found. Dec 03 15:02:15.334200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b4633b78-6399-4d38-9160-83166c0eb08a tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] Returning 404 to user: Volume ef98bdbf-ae16-4f33-820c-8c434bdfc240 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:02:15.335102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b4633b78-6399-4d38-9160-83166c0eb08a tempest-VolumesGetTestJSON-1248438436 tempest-VolumesGetTestJSON-1248438436] 10.222.0.63 "GET /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240" status: 404 len: 109 microversion: 2.1 time: 0.312799 Dec 03 15:02:15.335692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 9/14] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:15 2020] GET /compute/v2.1/os-volumes/ef98bdbf-ae16-4f33-820c-8c434bdfc240 => generated 109 bytes in 314 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:02:15.458487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8792dd6b-674f-40b6-973a-edd2638f8c80 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74010d0>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:15.654473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8792dd6b-674f-40b6-973a-edd2638f8c80 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0" status: 200 len: 287 microversion: 2.1 time: 0.206020 Dec 03 15:02:15.655389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 10/15] 10.222.0.63 () {58 vars in 1241 bytes} [Thu Dec 3 15:02:15 2020] GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0 => generated 287 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:02:16.673406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eb7230f4-f063-49b4-92f3-23fcf926f847 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74a9ea0>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:16.779533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eb7230f4-f063-49b4-92f3-23fcf926f847 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0" status: 200 len: 287 microversion: 2.1 time: 0.115892 Dec 03 15:02:16.785296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 11/16] 10.222.0.63 () {58 vars in 1241 bytes} [Thu Dec 3 15:02:16 2020] GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:17.053886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:02:17.054365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:02:17.055104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:02:17.055909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:02:17.056515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:02:17.069005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:17.070485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:17.071575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:17.072208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:17.120009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Getting quotas for project 59b1a509fdae412992f73a7d46115cad. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:17.129033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Getting quotas for user 14a9312880714eda8e1983a2190cd32e and project 59b1a509fdae412992f73a7d46115cad. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:17.147522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:02:17.152277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:02:17.293896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-13622d9f-87e3-49ce-ba04-757761fe9a23 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.273878 Dec 03 15:02:17.294971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 6/17] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:02:14 2020] POST /compute/v2.1/servers => generated 380 bytes in 3282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:02:17.316897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0dd2b4bd-02d4-4601-b09b-e063b1b48e19 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:17.318427 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0dd2b4bd-02d4-4601-b09b-e063b1b48e19 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:17.814443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ac69cd32-346b-418f-baa1-3b0dc701b5ce tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f73242f0>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:17.965158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ac69cd32-346b-418f-baa1-3b0dc701b5ce tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0" status: 200 len: 288 microversion: 2.1 time: 0.176938 Dec 03 15:02:17.966088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 7/18] 10.222.0.63 () {58 vars in 1241 bytes} [Thu Dec 3 15:02:17 2020] GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0 => generated 288 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:17.985153 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-18318222-9aa2-4e52-b1df-fd00044627c9 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74cbb70>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:18.080508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0dd2b4bd-02d4-4601-b09b-e063b1b48e19 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:18.115882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0dd2b4bd-02d4-4601-b09b-e063b1b48e19 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1214 microversion: 2.1 time: 0.811205 Dec 03 15:02:18.118039 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 12/19] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:17 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1214 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:18.293264 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-18318222-9aa2-4e52-b1df-fd00044627c9 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "DELETE /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0" status: 202 len: 0 microversion: 2.1 time: 0.318877 Dec 03 15:02:18.294650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 8/20] 10.222.0.63 () {58 vars in 1244 bytes} [Thu Dec 3 15:02:17 2020] DELETE /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:02:18.309049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e4715098-abf0-41ab-bb77-d41f08fdbf99 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74a9ae8>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:18.425472 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e4715098-abf0-41ab-bb77-d41f08fdbf99 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0" status: 200 len: 287 microversion: 2.1 time: 0.125507 Dec 03 15:02:18.426590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 13/21] 10.222.0.63 () {58 vars in 1241 bytes} [Thu Dec 3 15:02:18 2020] GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:18.473706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3913ae63-c6a6-46ee-b2bb-8685e2b86320 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f7324488>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:18.671686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3913ae63-c6a6-46ee-b2bb-8685e2b86320 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes/2a159efe-8521-45cb-b5bc-3a5a870ceadc" status: 200 len: 350 microversion: 2.1 time: 0.212304 Dec 03 15:02:18.672678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 9/22] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:18 2020] GET /compute/v2.1/os-volumes/2a159efe-8521-45cb-b5bc-3a5a870ceadc => generated 350 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:02:18.691533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9b0da15e-ee3f-47f4-8e1e-e5b8029c0bc7 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f73bea60>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:18.905796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9b0da15e-ee3f-47f4-8e1e-e5b8029c0bc7 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.224307 Dec 03 15:02:18.906787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 14/23] 10.222.0.63 () {58 vars in 1124 bytes} [Thu Dec 3 15:02:18 2020] GET /compute/v2.1/os-volumes => generated 1034 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:18.928798 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ecd50d65-341e-4f3e-bd8d-e34bfcf19ac0 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f73248c8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:19.144744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ecd50d65-341e-4f3e-bd8d-e34bfcf19ac0 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.229152 Dec 03 15:02:19.150677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 10/24] 10.222.0.63 () {58 vars in 1139 bytes} [Thu Dec 3 15:02:18 2020] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:19.156986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c8352c88-522f-4862-9022-7cd79a564e70 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:19.171104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c8352c88-522f-4862-9022-7cd79a564e70 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:19.177548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-67c2c9f9-76fd-423b-9b40-b15a8816c830 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f74cb378>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:19.432875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-67c2c9f9-76fd-423b-9b40-b15a8816c830 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.272483 Dec 03 15:02:19.433738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 11/25] 10.222.0.63 () {58 vars in 1124 bytes} [Thu Dec 3 15:02:19 2020] GET /compute/v2.1/os-volumes => generated 1034 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:19.451437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-286b7ceb-19d4-4aa6-988f-20135d0347f4 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f7324158>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:19.648805 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-286b7ceb-19d4-4aa6-988f-20135d0347f4 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] HTTP exception thrown: Snapshot b830333f-f8f9-4eb0-81ea-9a9c440a77e0 could not be found. Dec 03 15:02:19.649493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-286b7ceb-19d4-4aa6-988f-20135d0347f4 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Returning 404 to user: Snapshot b830333f-f8f9-4eb0-81ea-9a9c440a77e0 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:02:19.650483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-286b7ceb-19d4-4aa6-988f-20135d0347f4 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0" status: 404 len: 111 microversion: 2.1 time: 0.215523 Dec 03 15:02:19.652046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 12/26] 10.222.0.63 () {58 vars in 1241 bytes} [Thu Dec 3 15:02:19 2020] GET /compute/v2.1/os-snapshots/b830333f-f8f9-4eb0-81ea-9a9c440a77e0 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:02:19.666937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7183f399-bb4d-4c4d-beaa-d0a1c31f3e0a tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5fab7fbf8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:19.784423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c8352c88-522f-4862-9022-7cd79a564e70 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:19.835317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c8352c88-522f-4862-9022-7cd79a564e70 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1214 microversion: 2.1 time: 0.688799 Dec 03 15:02:19.850067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 15/27] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:19 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1214 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:19.886437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-820b65c9-43d8-4821-87e7-c9184c0739ec tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f73bed08>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:19.972792 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7183f399-bb4d-4c4d-beaa-d0a1c31f3e0a tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.318509 Dec 03 15:02:19.974301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 13/28] 10.222.0.63 () {58 vars in 1157 bytes} [Thu Dec 3 15:02:19 2020] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:19.996902 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8650325e-0fd5-460e-beda-3fecf0825901 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f7324b70>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:20.149468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-820b65c9-43d8-4821-87e7-c9184c0739ec tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "DELETE /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765" status: 202 len: 0 microversion: 2.1 time: 0.297821 Dec 03 15:02:20.150140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 16/29] 10.222.0.63 () {58 vars in 1238 bytes} [Thu Dec 3 15:02:19 2020] DELETE /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:02:20.166163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3d380c67-7659-4df8-853a-194e99582157 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74a9f28>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:20.214919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8650325e-0fd5-460e-beda-3fecf0825901 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.232372 Dec 03 15:02:20.219223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 14/30] 10.222.0.63 () {58 vars in 1160 bytes} [Thu Dec 3 15:02:19 2020] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:02:20.241084 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-72ba6685-280a-461e-bcd4-fde70d5e8b38 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f6aca268>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:20.329647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3d380c67-7659-4df8-853a-194e99582157 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765" status: 200 len: 343 microversion: 2.1 time: 0.174624 Dec 03 15:02:20.330857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 17/31] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:20 2020] GET /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765 => generated 343 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:20.357647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-72ba6685-280a-461e-bcd4-fde70d5e8b38 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.129652 Dec 03 15:02:20.359077 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 15/32] 10.222.0.63 () {58 vars in 1145 bytes} [Thu Dec 3 15:02:20 2020] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:20.380078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-edd6261a-6221-45a4-9f28-a72aac48e965 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f7401158>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:20.544761 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-edd6261a-6221-45a4-9f28-a72aac48e965 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.177781 Dec 03 15:02:20.546165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 18/33] 10.222.0.63 () {58 vars in 1178 bytes} [Thu Dec 3 15:02:20 2020] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:20.566950 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-772d49d1-e8fe-4efa-90bd-e0c660ab8f83 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] Calling method '.version_select at 0x7fd5f7324400>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:20.868391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4a23ca65-98ab-4aac-aa77-e4049764143c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:20.869111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4a23ca65-98ab-4aac-aa77-e4049764143c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:20.911896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-772d49d1-e8fe-4efa-90bd-e0c660ab8f83 tempest-VolumesTestJSON-1660630360 tempest-VolumesTestJSON-1660630360] 10.222.0.63 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.356377 Dec 03 15:02:20.912458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 16/34] 10.222.0.63 () {58 vars in 1145 bytes} [Thu Dec 3 15:02:20 2020] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:20.922645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a23ca65-98ab-4aac-aa77-e4049764143c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:20.923200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a23ca65-98ab-4aac-aa77-e4049764143c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:20.924186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a23ca65-98ab-4aac-aa77-e4049764143c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:20.924671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a23ca65-98ab-4aac-aa77-e4049764143c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:21.362941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a9712dd1-06d8-4570-b175-6273303bc3cb tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f73249d8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:21.571865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-a9712dd1-06d8-4570-b175-6273303bc3cb tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] HTTP exception thrown: Volume b076be95-b8f2-48a3-8ce3-8c6382968765 could not be found. Dec 03 15:02:21.572524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a9712dd1-06d8-4570-b175-6273303bc3cb tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Returning 404 to user: Volume b076be95-b8f2-48a3-8ce3-8c6382968765 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:02:21.573410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a9712dd1-06d8-4570-b175-6273303bc3cb tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765" status: 404 len: 109 microversion: 2.1 time: 0.234873 Dec 03 15:02:21.574045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 17/35] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:21 2020] GET /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765 => generated 109 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 15:02:21.600685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3a518667-fb2b-4510-96c7-0469061f1366 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f74cb378>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:21.709229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4a23ca65-98ab-4aac-aa77-e4049764143c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:21.757063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4a23ca65-98ab-4aac-aa77-e4049764143c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1272 microversion: 2.1 time: 0.898295 Dec 03 15:02:21.764671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 19/36] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:20 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1272 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:21.804055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-3a518667-fb2b-4510-96c7-0469061f1366 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] HTTP exception thrown: Volume b076be95-b8f2-48a3-8ce3-8c6382968765 could not be found. Dec 03 15:02:21.807707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3a518667-fb2b-4510-96c7-0469061f1366 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Returning 404 to user: Volume b076be95-b8f2-48a3-8ce3-8c6382968765 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:02:21.808685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3a518667-fb2b-4510-96c7-0469061f1366 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "DELETE /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765" status: 404 len: 109 microversion: 2.1 time: 0.221378 Dec 03 15:02:21.809267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 18/37] 10.222.0.63 () {58 vars in 1238 bytes} [Thu Dec 3 15:02:21 2020] DELETE /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765 => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 15:02:21.823533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0430a7f5-c03c-4293-b878-d435345000a9 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Calling method '.version_select at 0x7fd5f72cf0d0>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:22.011816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-0430a7f5-c03c-4293-b878-d435345000a9 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] HTTP exception thrown: Volume b076be95-b8f2-48a3-8ce3-8c6382968765 could not be found. Dec 03 15:02:22.012472 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0430a7f5-c03c-4293-b878-d435345000a9 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] Returning 404 to user: Volume b076be95-b8f2-48a3-8ce3-8c6382968765 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:02:22.013358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0430a7f5-c03c-4293-b878-d435345000a9 tempest-VolumesSnapshotsTestJSON-909333255 tempest-VolumesSnapshotsTestJSON-909333255] 10.222.0.63 "GET /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765" status: 404 len: 109 microversion: 2.1 time: 0.199015 Dec 03 15:02:22.014808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 20/38] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:02:21 2020] GET /compute/v2.1/os-volumes/b076be95-b8f2-48a3-8ce3-8c6382968765 => generated 109 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:02:22.792701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f8ec1ef2-6dde-44fb-82f5-d07a3f66a300 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:22.802298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f8ec1ef2-6dde-44fb-82f5-d07a3f66a300 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:22.832001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8ec1ef2-6dde-44fb-82f5-d07a3f66a300 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:22.832001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8ec1ef2-6dde-44fb-82f5-d07a3f66a300 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:22.832001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8ec1ef2-6dde-44fb-82f5-d07a3f66a300 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:22.843886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8ec1ef2-6dde-44fb-82f5-d07a3f66a300 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:24.024683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f8ec1ef2-6dde-44fb-82f5-d07a3f66a300 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:24.088827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f8ec1ef2-6dde-44fb-82f5-d07a3f66a300 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1272 microversion: 2.1 time: 1.309713 Dec 03 15:02:24.090799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 19/39] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:22 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1272 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:02:25.115360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ae1dbf68-e125-4e12-a540-0bc51a15c316 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:25.121076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ae1dbf68-e125-4e12-a540-0bc51a15c316 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:25.143265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ae1dbf68-e125-4e12-a540-0bc51a15c316 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:25.143764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ae1dbf68-e125-4e12-a540-0bc51a15c316 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:25.144636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ae1dbf68-e125-4e12-a540-0bc51a15c316 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:25.145115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ae1dbf68-e125-4e12-a540-0bc51a15c316 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:25.654220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ae1dbf68-e125-4e12-a540-0bc51a15c316 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:25.674427 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ae1dbf68-e125-4e12-a540-0bc51a15c316 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1272 microversion: 2.1 time: 0.570567 Dec 03 15:02:25.695148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 21/40] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:25 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1272 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:02:26.725135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0740ea5d-6c4d-4b96-b10e-ba2c57f1256f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:26.730951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0740ea5d-6c4d-4b96-b10e-ba2c57f1256f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:26.751610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0740ea5d-6c4d-4b96-b10e-ba2c57f1256f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:26.752465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0740ea5d-6c4d-4b96-b10e-ba2c57f1256f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:26.753584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0740ea5d-6c4d-4b96-b10e-ba2c57f1256f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:26.754320 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0740ea5d-6c4d-4b96-b10e-ba2c57f1256f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:27.164421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b1194e49-b51d-47e8-bbb6-5982c9dc5272 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'create', calling method: .version_select at 0x7fd5f6a620d0>, body: {"keypair": {"name": "tempest-keypair-1349560221"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:27.356401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-b1194e49-b51d-47e8-bbb6-5982c9dc5272 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:27.370674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-b1194e49-b51d-47e8-bbb6-5982c9dc5272 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for user dd9a3fdb0a0c44f6bdebf91a5d4e77b8 and project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:27.664485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0740ea5d-6c4d-4b96-b10e-ba2c57f1256f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:27.720143 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0740ea5d-6c4d-4b96-b10e-ba2c57f1256f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1272 microversion: 2.1 time: 1.002959 Dec 03 15:02:27.720864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 22/41] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:26 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1272 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:27.958864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-b1194e49-b51d-47e8-bbb6-5982c9dc5272 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:27.981206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-b1194e49-b51d-47e8-bbb6-5982c9dc5272 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for user dd9a3fdb0a0c44f6bdebf91a5d4e77b8 and project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:28.032916 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b1194e49-b51d-47e8-bbb6-5982c9dc5272 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.438720 Dec 03 15:02:28.037394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 20/42] 10.222.0.63 () {60 vars in 1148 bytes} [Thu Dec 3 15:02:26 2020] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:02:28.752096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f3b55fbe-112f-4967-8a24-239a1f986fb9 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:28.754555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f3b55fbe-112f-4967-8a24-239a1f986fb9 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:28.781264 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3b55fbe-112f-4967-8a24-239a1f986fb9 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:28.782182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3b55fbe-112f-4967-8a24-239a1f986fb9 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:28.783196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3b55fbe-112f-4967-8a24-239a1f986fb9 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:28.783771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3b55fbe-112f-4967-8a24-239a1f986fb9 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:29.710851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f3b55fbe-112f-4967-8a24-239a1f986fb9 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:29.745365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f3b55fbe-112f-4967-8a24-239a1f986fb9 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1272 microversion: 2.1 time: 1.007518 Dec 03 15:02:29.746677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 23/43] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:28 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1272 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:30.792791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-01aeac6c-d867-41cb-bd6c-4e1943b5b6c7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:30.797935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-01aeac6c-d867-41cb-bd6c-4e1943b5b6c7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:30.826915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-01aeac6c-d867-41cb-bd6c-4e1943b5b6c7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:30.831294 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-01aeac6c-d867-41cb-bd6c-4e1943b5b6c7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:30.833140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-01aeac6c-d867-41cb-bd6c-4e1943b5b6c7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:30.834985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-01aeac6c-d867-41cb-bd6c-4e1943b5b6c7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:31.768731 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-01aeac6c-d867-41cb-bd6c-4e1943b5b6c7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:31.804022 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-01aeac6c-d867-41cb-bd6c-4e1943b5b6c7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 1.042527 Dec 03 15:02:31.812870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 21/44] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:30 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:02:32.837285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7ded8d56-f278-4d8f-a0c8-8e75fa9aa0ad tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:32.845804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7ded8d56-f278-4d8f-a0c8-8e75fa9aa0ad tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:32.873101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ded8d56-f278-4d8f-a0c8-8e75fa9aa0ad tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:32.874374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ded8d56-f278-4d8f-a0c8-8e75fa9aa0ad tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:32.891052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ded8d56-f278-4d8f-a0c8-8e75fa9aa0ad tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:32.891564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ded8d56-f278-4d8f-a0c8-8e75fa9aa0ad tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:33.834131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7ded8d56-f278-4d8f-a0c8-8e75fa9aa0ad tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:33.859863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7ded8d56-f278-4d8f-a0c8-8e75fa9aa0ad tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 1.039797 Dec 03 15:02:33.862577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 24/45] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:32 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:34.886635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-03be11e3-68af-45f7-9b3d-7f8d01d624e0 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:34.887163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-03be11e3-68af-45f7-9b3d-7f8d01d624e0 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:34.945928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03be11e3-68af-45f7-9b3d-7f8d01d624e0 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:34.946459 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03be11e3-68af-45f7-9b3d-7f8d01d624e0 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:34.947327 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03be11e3-68af-45f7-9b3d-7f8d01d624e0 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:34.947824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03be11e3-68af-45f7-9b3d-7f8d01d624e0 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:36.670887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1655402458", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99cd7ca3-24f1-4d31-adf2-9e1bba032327"}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:36.885104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-03be11e3-68af-45f7-9b3d-7f8d01d624e0 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:36.922453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-03be11e3-68af-45f7-9b3d-7f8d01d624e0 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 2.041607 Dec 03 15:02:36.923157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 22/46] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:34 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:36.945488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] validate_networks() for [('99cd7ca3-24f1-4d31-adf2-9e1bba032327', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:02:37.871839 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1418405773", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2263eb43-6c9e-40c3-9734-975854f0ad70"}], "security_groups": [{"name": "tempest-securitygroup--1915493662"}], "key_name": "tempest-keypair-1349560221", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:38.612885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] validate_networks() for [('2263eb43-6c9e-40c3-9734-975854f0ad70', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:02:40.073020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:02:40.074265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:02:40.074939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:02:40.075521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:02:40.076326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:02:40.101886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:40.105332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:40.106576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:40.110771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:40.198595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Getting quotas for project 69f1305b325747b387eaa173734086a5. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:40.209650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Getting quotas for user ad7384f2208849dc8fdfab81756ad1ed and project 69f1305b325747b387eaa173734086a5. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:40.226875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:02:40.230191 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:02:40.381345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9ad04d87-5ed2-457f-94c2-d6214b91e7f3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.398910 Dec 03 15:02:40.386980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 25/47] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:02:35 2020] POST /compute/v2.1/servers => generated 383 bytes in 4405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:02:40.416111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-66673031-c2e4-47de-9220-1449e0b6dc3a tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:40.417383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-66673031-c2e4-47de-9220-1449e0b6dc3a tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:40.439114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66673031-c2e4-47de-9220-1449e0b6dc3a tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:40.448172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66673031-c2e4-47de-9220-1449e0b6dc3a tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:40.449962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66673031-c2e4-47de-9220-1449e0b6dc3a tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:40.450689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66673031-c2e4-47de-9220-1449e0b6dc3a tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:41.112569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-66673031-c2e4-47de-9220-1449e0b6dc3a tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:41.143195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-66673031-c2e4-47de-9220-1449e0b6dc3a tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 0.747913 Dec 03 15:02:41.153206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 26/48] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:40 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:42.014500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-130bc847-dc2f-4d56-9242-7ce22590c45d req-e61b48cd-0196-4e93-adcc-e264ef919eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df8e3bd-8dd7-4ac4-9409-df9187c8a651", "tag": "25ef8b7b-be10-454b-bfbd-bfa8f9585236"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:42.037339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:02:42.037339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:02:42.069992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-130bc847-dc2f-4d56-9242-7ce22590c45d req-e61b48cd-0196-4e93-adcc-e264ef919eb6 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.073849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-130bc847-dc2f-4d56-9242-7ce22590c45d req-e61b48cd-0196-4e93-adcc-e264ef919eb6 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.146083 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-130bc847-dc2f-4d56-9242-7ce22590c45d req-e61b48cd-0196-4e93-adcc-e264ef919eb6 service nova] Creating event network-changed:25ef8b7b-be10-454b-bfbd-bfa8f9585236 for instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 on hv-cinder-75790 Dec 03 15:02:42.148240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-130bc847-dc2f-4d56-9242-7ce22590c45d req-e61b48cd-0196-4e93-adcc-e264ef919eb6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:02:42.155642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca5dee72-0757-4847-8cb0-37db68d8e5a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.160764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca5dee72-0757-4847-8cb0-37db68d8e5a4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.161812 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca5dee72-0757-4847-8cb0-37db68d8e5a4 None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.162450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca5dee72-0757-4847-8cb0-37db68d8e5a4 None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.195393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.compute.rpcapi [None req-ca5dee72-0757-4847-8cb0-37db68d8e5a4 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 03 15:02:42.199498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca5dee72-0757-4847-8cb0-37db68d8e5a4 None None] Releasing lock "compute-rpcapi-router" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:02:42.322159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ca5dee72-0757-4847-8cb0-37db68d8e5a4 None None] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.167090 Dec 03 15:02:42.323329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 27/49] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:02:41 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:42.339706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1578c2ce-3148-43de-9317-d2797cae8b32 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:42.358137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1578c2ce-3148-43de-9317-d2797cae8b32 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:42.400584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1578c2ce-3148-43de-9317-d2797cae8b32 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.404492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1578c2ce-3148-43de-9317-d2797cae8b32 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.406695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1578c2ce-3148-43de-9317-d2797cae8b32 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.411869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1578c2ce-3148-43de-9317-d2797cae8b32 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.617672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:02:42.620389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:02:42.624441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:02:42.625852 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:02:42.626517 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:02:42.646478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.647172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.648211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.648840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.708449 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:42.722974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for user dd9a3fdb0a0c44f6bdebf91a5d4e77b8 and project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:42.762267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:02:42.769183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1578c2ce-3148-43de-9317-d2797cae8b32 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:42.771264 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:02:42.805593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1578c2ce-3148-43de-9317-d2797cae8b32 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1226 microversion: 2.1 time: 0.480821 Dec 03 15:02:42.818859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 28/50] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:42 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1226 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:42.840008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1be2adb6-6a68-4fd4-81e8-047b8a4b8e0f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:42.840963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1be2adb6-6a68-4fd4-81e8-047b8a4b8e0f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:42.854769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1be2adb6-6a68-4fd4-81e8-047b8a4b8e0f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.855497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1be2adb6-6a68-4fd4-81e8-047b8a4b8e0f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.856554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1be2adb6-6a68-4fd4-81e8-047b8a4b8e0f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:42.857382 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1be2adb6-6a68-4fd4-81e8-047b8a4b8e0f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:42.972158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d8fe6a26-0025-44bd-8a05-70b5f07bd5e9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.111042 Dec 03 15:02:42.976801 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 23/51] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:02:37 2020] POST /compute/v2.1/servers => generated 402 bytes in 5118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:02:43.023849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-aba9ad4a-7fd3-4fa1-861d-3ccef9958396 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:43.024527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-aba9ad4a-7fd3-4fa1-861d-3ccef9958396 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:43.419489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1be2adb6-6a68-4fd4-81e8-047b8a4b8e0f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:43.431386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1be2adb6-6a68-4fd4-81e8-047b8a4b8e0f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 0.610955 Dec 03 15:02:43.436238 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 29/52] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:42 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:43.458766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1643212250", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99cd7ca3-24f1-4d31-adf2-9e1bba032327"}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:43.638419 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] validate_networks() for [('99cd7ca3-24f1-4d31-adf2-9e1bba032327', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:02:43.808237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-aba9ad4a-7fd3-4fa1-861d-3ccef9958396 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:43.835787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-aba9ad4a-7fd3-4fa1-861d-3ccef9958396 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1238 microversion: 2.1 time: 0.856306 Dec 03 15:02:43.842052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 24/53] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:42 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1238 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:44.928108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0abbe820-f2fc-4a68-98f5-c7a5f24634f1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'create', calling method: .version_select at 0x7fd5f61b3488>, body: {"keypair": {"name": "tempest-keypair-468958215"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:45.000674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-0abbe820-f2fc-4a68-98f5-c7a5f24634f1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for project f608c43dc4544cf8abe2b82be12c9880. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:45.004957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-0abbe820-f2fc-4a68-98f5-c7a5f24634f1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for user 02eb117eb6b349819521771a97d3ff11 and project f608c43dc4544cf8abe2b82be12c9880. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:45.381832 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-0abbe820-f2fc-4a68-98f5-c7a5f24634f1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for project f608c43dc4544cf8abe2b82be12c9880. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:45.386396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-0abbe820-f2fc-4a68-98f5-c7a5f24634f1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for user 02eb117eb6b349819521771a97d3ff11 and project f608c43dc4544cf8abe2b82be12c9880. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:45.409931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0abbe820-f2fc-4a68-98f5-c7a5f24634f1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.303845 Dec 03 15:02:45.411312 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 25/54] 10.222.0.63 () {62 vars in 1189 bytes} [Thu Dec 3 15:02:44 2020] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1306 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 03 15:02:45.438918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3f81c620-9e85-442c-be65-36a6e6ef5e9d tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:45.440140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3f81c620-9e85-442c-be65-36a6e6ef5e9d tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:45.466981 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f81c620-9e85-442c-be65-36a6e6ef5e9d tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:45.467923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f81c620-9e85-442c-be65-36a6e6ef5e9d tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:45.469966 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f81c620-9e85-442c-be65-36a6e6ef5e9d tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:45.470675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f81c620-9e85-442c-be65-36a6e6ef5e9d tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:46.652897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:02:46.654378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:02:46.655351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:02:46.656206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:02:46.657384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:02:46.668524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:46.669252 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:46.670678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:46.671366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:46.693772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Getting quotas for project 69f1305b325747b387eaa173734086a5. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:46.699751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Getting quotas for user ad7384f2208849dc8fdfab81756ad1ed and project 69f1305b325747b387eaa173734086a5. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:46.722299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:02:46.725777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:02:46.792153 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-67fbe648-606d-430e-9cc6-c519a527c017 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.354239 Dec 03 15:02:46.794233 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 30/55] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:02:43 2020] POST /compute/v2.1/servers => generated 383 bytes in 3357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:02:46.815260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6115ec50-8de8-480d-833d-ceb97506dc94 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:46.817181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6115ec50-8de8-480d-833d-ceb97506dc94 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:46.836622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6115ec50-8de8-480d-833d-ceb97506dc94 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:46.837132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6115ec50-8de8-480d-833d-ceb97506dc94 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:46.838024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6115ec50-8de8-480d-833d-ceb97506dc94 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:46.838516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6115ec50-8de8-480d-833d-ceb97506dc94 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:46.991901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6115ec50-8de8-480d-833d-ceb97506dc94 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:47.002629 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6115ec50-8de8-480d-833d-ceb97506dc94 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1296 microversion: 2.1 time: 0.206858 Dec 03 15:02:47.003407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 31/56] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:46 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1296 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:47.014370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4f5ea824-a900-4ca4-8207-beec8d24a419 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:47.015845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4f5ea824-a900-4ca4-8207-beec8d24a419 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:47.202317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4f5ea824-a900-4ca4-8207-beec8d24a419 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:47.236694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4f5ea824-a900-4ca4-8207-beec8d24a419 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1222 microversion: 2.1 time: 0.231912 Dec 03 15:02:47.237321 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 32/57] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:47 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:47.274722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3f81c620-9e85-442c-be65-36a6e6ef5e9d tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:47.312671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3f81c620-9e85-442c-be65-36a6e6ef5e9d tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 1.897659 Dec 03 15:02:47.313319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 26/58] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:45 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:48.027493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5da9b409-f3fb-4f35-9c04-4df30d0cab00 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:48.031035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5da9b409-f3fb-4f35-9c04-4df30d0cab00 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:48.044362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5da9b409-f3fb-4f35-9c04-4df30d0cab00 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.045202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5da9b409-f3fb-4f35-9c04-4df30d0cab00 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.046106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5da9b409-f3fb-4f35-9c04-4df30d0cab00 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.046750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5da9b409-f3fb-4f35-9c04-4df30d0cab00 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.260288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ea1cd20c-be23-4ea1-ba6c-e15c91eb2bd7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:48.262667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ea1cd20c-be23-4ea1-ba6c-e15c91eb2bd7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:48.289598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea1cd20c-be23-4ea1-ba6c-e15c91eb2bd7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.290364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea1cd20c-be23-4ea1-ba6c-e15c91eb2bd7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.291368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea1cd20c-be23-4ea1-ba6c-e15c91eb2bd7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.292000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea1cd20c-be23-4ea1-ba6c-e15c91eb2bd7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.315316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5da9b409-f3fb-4f35-9c04-4df30d0cab00 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:48.355166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5da9b409-f3fb-4f35-9c04-4df30d0cab00 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1296 microversion: 2.1 time: 0.334540 Dec 03 15:02:48.358808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 33/59] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:48 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1296 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:48.381723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-38c09efc-5b69-4b15-9fe9-3129b632f303 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:48.390955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-38c09efc-5b69-4b15-9fe9-3129b632f303 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:48.418190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38c09efc-5b69-4b15-9fe9-3129b632f303 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.429407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38c09efc-5b69-4b15-9fe9-3129b632f303 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.430336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38c09efc-5b69-4b15-9fe9-3129b632f303 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.430961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38c09efc-5b69-4b15-9fe9-3129b632f303 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.524162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ea1cd20c-be23-4ea1-ba6c-e15c91eb2bd7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:48.542665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ea1cd20c-be23-4ea1-ba6c-e15c91eb2bd7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1226 microversion: 2.1 time: 0.291154 Dec 03 15:02:48.543846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 27/60] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:48 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1226 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:48.792672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-a890117e-f2be-4ff2-8037-9c4200856422 req-da003910-450b-48f1-8c33-fc03c1a321ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df8e3bd-8dd7-4ac4-9409-df9187c8a651", "name": "network-vif-plugged", "status": "completed", "tag": "25ef8b7b-be10-454b-bfbd-bfa8f9585236"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:48.801810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:02:48.801810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:02:48.811650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a890117e-f2be-4ff2-8037-9c4200856422 req-da003910-450b-48f1-8c33-fc03c1a321ce service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.812429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a890117e-f2be-4ff2-8037-9c4200856422 req-da003910-450b-48f1-8c33-fc03c1a321ce service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.831555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-a890117e-f2be-4ff2-8037-9c4200856422 req-da003910-450b-48f1-8c33-fc03c1a321ce service nova] Creating event network-vif-plugged:25ef8b7b-be10-454b-bfbd-bfa8f9585236 for instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 on hv-cinder-75790 Dec 03 15:02:48.832437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a890117e-f2be-4ff2-8037-9c4200856422 req-da003910-450b-48f1-8c33-fc03c1a321ce service nova] Acquired lock "compute-rpcapi-router" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:02:48.834388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af860731-096b-4ea2-bf7e-64e08619ea9b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.835066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af860731-096b-4ea2-bf7e-64e08619ea9b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.836103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af860731-096b-4ea2-bf7e-64e08619ea9b None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:48.836786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af860731-096b-4ea2-bf7e-64e08619ea9b None None] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:48.848365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.compute.rpcapi [None req-af860731-096b-4ea2-bf7e-64e08619ea9b None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 03 15:02:48.850446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af860731-096b-4ea2-bf7e-64e08619ea9b None None] Releasing lock "compute-rpcapi-router" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:02:48.882535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-af860731-096b-4ea2-bf7e-64e08619ea9b None None] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277391 Dec 03 15:02:48.883923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 28/61] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:02:48 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:02:49.161666 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-38c09efc-5b69-4b15-9fe9-3129b632f303 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:49.182983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-38c09efc-5b69-4b15-9fe9-3129b632f303 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 0.822701 Dec 03 15:02:49.183593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 34/62] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:48 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:49.385233 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eb260533-36a0-4f6a-b761-4ea2b4b09f32 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:49.390084 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-eb260533-36a0-4f6a-b761-4ea2b4b09f32 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:49.413618 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb260533-36a0-4f6a-b761-4ea2b4b09f32 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:49.414186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb260533-36a0-4f6a-b761-4ea2b4b09f32 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:49.444177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb260533-36a0-4f6a-b761-4ea2b4b09f32 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:49.444810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb260533-36a0-4f6a-b761-4ea2b4b09f32 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:49.571418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1bb0c357-e86f-4f55-9fbf-1a93f142b5fe tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:49.572269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1bb0c357-e86f-4f55-9fbf-1a93f142b5fe tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:49.598381 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1bb0c357-e86f-4f55-9fbf-1a93f142b5fe tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:49.599199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1bb0c357-e86f-4f55-9fbf-1a93f142b5fe tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:49.600208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1bb0c357-e86f-4f55-9fbf-1a93f142b5fe tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:49.600861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1bb0c357-e86f-4f55-9fbf-1a93f142b5fe tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:49.679446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-eb260533-36a0-4f6a-b761-4ea2b4b09f32 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:49.703834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eb260533-36a0-4f6a-b761-4ea2b4b09f32 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1296 microversion: 2.1 time: 0.332176 Dec 03 15:02:49.712984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 29/63] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:49 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1296 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:50.018409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1bb0c357-e86f-4f55-9fbf-1a93f142b5fe tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:50.056668 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1bb0c357-e86f-4f55-9fbf-1a93f142b5fe tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1218 microversion: 2.1 time: 0.499770 Dec 03 15:02:50.057518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 35/64] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:49 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1218 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:50.209441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-470aff4d-cdb5-4918-a8bd-5bc4ac9ca5c6 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:50.210167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-470aff4d-cdb5-4918-a8bd-5bc4ac9ca5c6 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:50.233773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-470aff4d-cdb5-4918-a8bd-5bc4ac9ca5c6 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:50.240624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-470aff4d-cdb5-4918-a8bd-5bc4ac9ca5c6 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:50.242357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-470aff4d-cdb5-4918-a8bd-5bc4ac9ca5c6 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:50.243008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-470aff4d-cdb5-4918-a8bd-5bc4ac9ca5c6 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:50.736953 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e21b6ae5-39a2-42dd-948d-8fb1f1ba3f81 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:50.737846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e21b6ae5-39a2-42dd-948d-8fb1f1ba3f81 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:50.777430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e21b6ae5-39a2-42dd-948d-8fb1f1ba3f81 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:50.778234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e21b6ae5-39a2-42dd-948d-8fb1f1ba3f81 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:50.780505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e21b6ae5-39a2-42dd-948d-8fb1f1ba3f81 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:50.782630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e21b6ae5-39a2-42dd-948d-8fb1f1ba3f81 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:51.600419 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-470aff4d-cdb5-4918-a8bd-5bc4ac9ca5c6 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:51.619310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-470aff4d-cdb5-4918-a8bd-5bc4ac9ca5c6 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 1.419816 Dec 03 15:02:51.619848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 30/65] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:50 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:51.654728 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2aaa1e60-e004-4324-80f3-4f1788981e83 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:51.655407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2aaa1e60-e004-4324-80f3-4f1788981e83 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:51.679705 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2aaa1e60-e004-4324-80f3-4f1788981e83 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:51.680227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2aaa1e60-e004-4324-80f3-4f1788981e83 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:51.681102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2aaa1e60-e004-4324-80f3-4f1788981e83 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:51.681602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2aaa1e60-e004-4324-80f3-4f1788981e83 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:51.990990 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e21b6ae5-39a2-42dd-948d-8fb1f1ba3f81 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:52.007490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e21b6ae5-39a2-42dd-948d-8fb1f1ba3f81 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1296 microversion: 2.1 time: 1.281271 Dec 03 15:02:52.008715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 36/66] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:50 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1296 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:52.227665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2aaa1e60-e004-4324-80f3-4f1788981e83 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:52.248959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2aaa1e60-e004-4324-80f3-4f1788981e83 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1280 microversion: 2.1 time: 0.611270 Dec 03 15:02:52.250461 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 31/67] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:51 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1280 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:52.646166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2f5e516d-ec12-427d-af46-21cd0df053e7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:52.646895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2f5e516d-ec12-427d-af46-21cd0df053e7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:52.661458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f5e516d-ec12-427d-af46-21cd0df053e7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:52.661986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f5e516d-ec12-427d-af46-21cd0df053e7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:52.664904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f5e516d-ec12-427d-af46-21cd0df053e7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:52.665934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f5e516d-ec12-427d-af46-21cd0df053e7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:53.115545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2f5e516d-ec12-427d-af46-21cd0df053e7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:53.145494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2f5e516d-ec12-427d-af46-21cd0df053e7 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 0.510443 Dec 03 15:02:53.157824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 32/68] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:52 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:53.174222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-663897fe-d44f-4b87-99bf-dbae4f9eb11f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:53.175014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-663897fe-d44f-4b87-99bf-dbae4f9eb11f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:53.183968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-663897fe-d44f-4b87-99bf-dbae4f9eb11f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:53.184480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-663897fe-d44f-4b87-99bf-dbae4f9eb11f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:53.186144 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-663897fe-d44f-4b87-99bf-dbae4f9eb11f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:53.186462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-663897fe-d44f-4b87-99bf-dbae4f9eb11f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:53.238339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-4ef682cb-c3ca-4e4a-8c0e-a906a53e1cf7 req-3057d02e-c2f4-4130-ae3b-d9fe207c6bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c233978f-9c32-47bf-8b66-44f0baa08830", "tag": "4fcc7ba2-ca25-407b-8386-4f72181d346e"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:53.254823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:02:53.254823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:02:53.272699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-4ef682cb-c3ca-4e4a-8c0e-a906a53e1cf7 req-3057d02e-c2f4-4130-ae3b-d9fe207c6bdc service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:53.273370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-4ef682cb-c3ca-4e4a-8c0e-a906a53e1cf7 req-3057d02e-c2f4-4130-ae3b-d9fe207c6bdc service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:53.302446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-4ef682cb-c3ca-4e4a-8c0e-a906a53e1cf7 req-3057d02e-c2f4-4130-ae3b-d9fe207c6bdc service nova] Creating event network-changed:4fcc7ba2-ca25-407b-8386-4f72181d346e for instance c233978f-9c32-47bf-8b66-44f0baa08830 on hv-cinder-75790 Dec 03 15:02:53.309207 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-4ef682cb-c3ca-4e4a-8c0e-a906a53e1cf7 req-3057d02e-c2f4-4130-ae3b-d9fe207c6bdc service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.697241 Dec 03 15:02:53.312298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 37/69] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:02:52 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:02:53.323841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1eb1f4ef-aa3f-440c-a976-10e338c6d3dc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:53.325040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1eb1f4ef-aa3f-440c-a976-10e338c6d3dc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:53.335253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1eb1f4ef-aa3f-440c-a976-10e338c6d3dc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:53.336375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1eb1f4ef-aa3f-440c-a976-10e338c6d3dc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:53.337422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1eb1f4ef-aa3f-440c-a976-10e338c6d3dc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:53.338299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1eb1f4ef-aa3f-440c-a976-10e338c6d3dc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:53.360015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-663897fe-d44f-4b87-99bf-dbae4f9eb11f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:53.371037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-663897fe-d44f-4b87-99bf-dbae4f9eb11f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1296 microversion: 2.1 time: 0.217771 Dec 03 15:02:53.372018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 33/70] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:53 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1296 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:53.606491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1eb1f4ef-aa3f-440c-a976-10e338c6d3dc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:53.623190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1eb1f4ef-aa3f-440c-a976-10e338c6d3dc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1280 microversion: 2.1 time: 0.308598 Dec 03 15:02:53.623938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 38/71] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:53 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1280 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:54.169388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-de73c3ee-0284-4fb9-b4ee-725535e49faf tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:54.170929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-de73c3ee-0284-4fb9-b4ee-725535e49faf tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:54.181161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-de73c3ee-0284-4fb9-b4ee-725535e49faf tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:54.181937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-de73c3ee-0284-4fb9-b4ee-725535e49faf tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:54.182970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-de73c3ee-0284-4fb9-b4ee-725535e49faf tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:54.184180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-de73c3ee-0284-4fb9-b4ee-725535e49faf tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:54.396117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7546bcf9-d20d-459b-afa2-12aa15be7f07 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:54.397038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7546bcf9-d20d-459b-afa2-12aa15be7f07 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:54.407616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7546bcf9-d20d-459b-afa2-12aa15be7f07 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:54.408456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7546bcf9-d20d-459b-afa2-12aa15be7f07 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:54.409966 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7546bcf9-d20d-459b-afa2-12aa15be7f07 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:54.411213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7546bcf9-d20d-459b-afa2-12aa15be7f07 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:54.537285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-de73c3ee-0284-4fb9-b4ee-725535e49faf tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:54.548930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-de73c3ee-0284-4fb9-b4ee-725535e49faf tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 0.387766 Dec 03 15:02:54.550522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 34/72] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:54 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:54.647628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-33416c6e-c05f-4a24-baba-7d8e4f0e460c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:54.648689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-33416c6e-c05f-4a24-baba-7d8e4f0e460c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:54.664130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-33416c6e-c05f-4a24-baba-7d8e4f0e460c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:54.664811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-33416c6e-c05f-4a24-baba-7d8e4f0e460c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:54.665788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-33416c6e-c05f-4a24-baba-7d8e4f0e460c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:54.666426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-33416c6e-c05f-4a24-baba-7d8e4f0e460c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:54.940164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-33416c6e-c05f-4a24-baba-7d8e4f0e460c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:54.949983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-33416c6e-c05f-4a24-baba-7d8e4f0e460c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1280 microversion: 2.1 time: 0.312749 Dec 03 15:02:54.955519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 35/73] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:54 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1280 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:02:55.402494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7546bcf9-d20d-459b-afa2-12aa15be7f07 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:55.413136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7546bcf9-d20d-459b-afa2-12aa15be7f07 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 1.027453 Dec 03 15:02:55.424135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 39/74] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:54 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:55.483861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1133627482", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b89cab8b-b39a-4106-adb3-9bedf452bb83"}], "security_groups": [{"name": "tempest-securitygroup--945820114"}], "key_name": "tempest-keypair-468958215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:02:55.573439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-12ec450f-de05-40d0-bafb-79ebc89e4f49 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:55.574493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-12ec450f-de05-40d0-bafb-79ebc89e4f49 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:55.584389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-12ec450f-de05-40d0-bafb-79ebc89e4f49 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:55.585108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-12ec450f-de05-40d0-bafb-79ebc89e4f49 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:55.586268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-12ec450f-de05-40d0-bafb-79ebc89e4f49 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:55.586766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-12ec450f-de05-40d0-bafb-79ebc89e4f49 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:55.661379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] validate_networks() for [('b89cab8b-b39a-4106-adb3-9bedf452bb83', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:02:55.838780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-12ec450f-de05-40d0-bafb-79ebc89e4f49 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:55.850715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-12ec450f-de05-40d0-bafb-79ebc89e4f49 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 0.286740 Dec 03 15:02:55.851682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 40/75] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:55 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:55.973955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4621a49e-471e-4560-8b54-375cd64c44ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:55.974900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4621a49e-471e-4560-8b54-375cd64c44ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:55.983471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4621a49e-471e-4560-8b54-375cd64c44ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:55.983977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4621a49e-471e-4560-8b54-375cd64c44ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:55.984812 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4621a49e-471e-4560-8b54-375cd64c44ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:55.985267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4621a49e-471e-4560-8b54-375cd64c44ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:56.410295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4621a49e-471e-4560-8b54-375cd64c44ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:56.420575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:02:56.421168 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:02:56.421544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4621a49e-471e-4560-8b54-375cd64c44ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.457848 Dec 03 15:02:56.421646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:02:56.422076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:02:56.422543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:02:56.431529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 41/76] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:55 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:56.439366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:56.439925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:56.440806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:56.441299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:56.443620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ddb1ac6a-6c1b-4453-b447-bd6a25d9b0a7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:56.444532 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ddb1ac6a-6c1b-4453-b447-bd6a25d9b0a7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:56.454152 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ddb1ac6a-6c1b-4453-b447-bd6a25d9b0a7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:56.454951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ddb1ac6a-6c1b-4453-b447-bd6a25d9b0a7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:56.456011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ddb1ac6a-6c1b-4453-b447-bd6a25d9b0a7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:56.456739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ddb1ac6a-6c1b-4453-b447-bd6a25d9b0a7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:56.461879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for project f608c43dc4544cf8abe2b82be12c9880. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:02:56.467033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for user 02eb117eb6b349819521771a97d3ff11 and project f608c43dc4544cf8abe2b82be12c9880. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:02:56.479002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:02:56.481619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:02:56.550139 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a6d35c89-c4ff-4c50-bcd3-eea3dd9ca485 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.076156 Dec 03 15:02:56.556566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 36/77] 10.222.0.63 () {62 vars in 1178 bytes} [Thu Dec 3 15:02:55 2020] POST /compute/v2.1/servers => generated 401 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 03 15:02:56.594221 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ebd20d73-449d-4e6b-a9ff-871787e325df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:56.595072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ebd20d73-449d-4e6b-a9ff-871787e325df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:56.706707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ebd20d73-449d-4e6b-a9ff-871787e325df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:56.724418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ebd20d73-449d-4e6b-a9ff-871787e325df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:56.731552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ebd20d73-449d-4e6b-a9ff-871787e325df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:56.732952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ebd20d73-449d-4e6b-a9ff-871787e325df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1281 microversion: 2.20 time: 0.175311 Dec 03 15:02:56.733543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 37/78] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:02:56 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:02:56.804459 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ddb1ac6a-6c1b-4453-b447-bd6a25d9b0a7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:56.837869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ddb1ac6a-6c1b-4453-b447-bd6a25d9b0a7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.402320 Dec 03 15:02:56.840037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 42/79] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:56 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:56.876670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-abbdc1c2-701b-44d2-8585-a2b58b3f4c1e tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:56.877324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-abbdc1c2-701b-44d2-8585-a2b58b3f4c1e tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:56.898903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abbdc1c2-701b-44d2-8585-a2b58b3f4c1e tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:56.901068 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abbdc1c2-701b-44d2-8585-a2b58b3f4c1e tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:56.901982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abbdc1c2-701b-44d2-8585-a2b58b3f4c1e tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:56.902490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abbdc1c2-701b-44d2-8585-a2b58b3f4c1e tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:57.133129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-abbdc1c2-701b-44d2-8585-a2b58b3f4c1e tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:57.142555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-abbdc1c2-701b-44d2-8585-a2b58b3f4c1e tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 0.277449 Dec 03 15:02:57.143387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 38/80] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:56 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:57.444266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fa511f7a-eaa7-4037-ae02-a99bf98cc879 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:57.444931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fa511f7a-eaa7-4037-ae02-a99bf98cc879 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:57.452757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fa511f7a-eaa7-4037-ae02-a99bf98cc879 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:57.453268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fa511f7a-eaa7-4037-ae02-a99bf98cc879 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:57.454139 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fa511f7a-eaa7-4037-ae02-a99bf98cc879 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:57.454633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fa511f7a-eaa7-4037-ae02-a99bf98cc879 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:57.688396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fa511f7a-eaa7-4037-ae02-a99bf98cc879 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:57.697083 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fa511f7a-eaa7-4037-ae02-a99bf98cc879 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.262403 Dec 03 15:02:57.697671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 43/81] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:57 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:57.757627 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:57.758438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:57.767529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:57.768038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:57.768906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:57.769426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:57.863893 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4f8ad5c7-61ed-4286-8617-995c4750f6c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:57.868381 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4f8ad5c7-61ed-4286-8617-995c4750f6c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:57.882509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5c7-61ed-4286-8617-995c4750f6c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:57.883023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5c7-61ed-4286-8617-995c4750f6c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:57.884151 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5c7-61ed-4286-8617-995c4750f6c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:57.884657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5c7-61ed-4286-8617-995c4750f6c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:58.030649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:58.058096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:58.066377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:58.067743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3e63f71c-060a-47b0-8467-bbfbff217f83 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1285 microversion: 2.20 time: 0.320173 Dec 03 15:02:58.068767 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 39/82] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:02:57 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1285 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:02:58.166842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-470bf01b-71a8-41da-ab29-b4e519bb0a02 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:58.167434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-470bf01b-71a8-41da-ab29-b4e519bb0a02 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:58.175934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-470bf01b-71a8-41da-ab29-b4e519bb0a02 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:58.176463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-470bf01b-71a8-41da-ab29-b4e519bb0a02 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:58.177315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-470bf01b-71a8-41da-ab29-b4e519bb0a02 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:58.177801 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-470bf01b-71a8-41da-ab29-b4e519bb0a02 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:58.478751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-470bf01b-71a8-41da-ab29-b4e519bb0a02 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:58.489578 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-470bf01b-71a8-41da-ab29-b4e519bb0a02 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1314 microversion: 2.1 time: 0.332230 Dec 03 15:02:58.490620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 40/83] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:58 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:02:58.725035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7f5cbe1e-f60f-4fa0-9fd6-6b8ef26aa17f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:58.725749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7f5cbe1e-f60f-4fa0-9fd6-6b8ef26aa17f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:58.740028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4f8ad5c7-61ed-4286-8617-995c4750f6c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:58.754930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4f8ad5c7-61ed-4286-8617-995c4750f6c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.902209 Dec 03 15:02:58.763715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 44/84] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:57 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:02:58.773463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f5cbe1e-f60f-4fa0-9fd6-6b8ef26aa17f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:58.773463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f5cbe1e-f60f-4fa0-9fd6-6b8ef26aa17f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:58.773463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f5cbe1e-f60f-4fa0-9fd6-6b8ef26aa17f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:58.774152 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f5cbe1e-f60f-4fa0-9fd6-6b8ef26aa17f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:59.103158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:59.104066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:59.126281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:59.126964 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:59.127984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:59.128620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:59.463060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:59.492343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:59.508969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:59.515289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ffba636a-d689-4ef4-91bc-8523f0baa98b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1339 microversion: 2.20 time: 0.430423 Dec 03 15:02:59.515915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 45/85] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:02:59 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1339 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:02:59.530614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ccaf7c3e-d626-4f17-90a9-5d961e24f39c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:02:59.531451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ccaf7c3e-d626-4f17-90a9-5d961e24f39c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:02:59.540288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccaf7c3e-d626-4f17-90a9-5d961e24f39c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:59.542120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccaf7c3e-d626-4f17-90a9-5d961e24f39c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:59.542120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccaf7c3e-d626-4f17-90a9-5d961e24f39c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:02:59.542826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccaf7c3e-d626-4f17-90a9-5d961e24f39c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:02:59.976519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7f5cbe1e-f60f-4fa0-9fd6-6b8ef26aa17f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:02:59.992799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7f5cbe1e-f60f-4fa0-9fd6-6b8ef26aa17f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 1.279871 Dec 03 15:02:59.994298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 41/86] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:58 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:00.008917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-84ebc6d4-044e-4473-afcd-e4f94efdf9b5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:00.010163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-84ebc6d4-044e-4473-afcd-e4f94efdf9b5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:00.020895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84ebc6d4-044e-4473-afcd-e4f94efdf9b5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:00.021956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84ebc6d4-044e-4473-afcd-e4f94efdf9b5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:00.023784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84ebc6d4-044e-4473-afcd-e4f94efdf9b5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:00.024567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84ebc6d4-044e-4473-afcd-e4f94efdf9b5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:00.668021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-84ebc6d4-044e-4473-afcd-e4f94efdf9b5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:00.678419 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-84ebc6d4-044e-4473-afcd-e4f94efdf9b5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.682763 Dec 03 15:03:00.679565 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 42/87] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:59 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:00.701274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:00.702361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:00.711636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:00.712492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:00.713503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:00.714186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:00.884848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:00.901521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:00.910316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:00.911505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5f036d45-91de-4fee-9a51-70ffca218da4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1339 microversion: 2.20 time: 0.219580 Dec 03 15:03:00.912110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 43/88] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:00 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1339 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:00.941936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ccaf7c3e-d626-4f17-90a9-5d961e24f39c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:00.952066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ccaf7c3e-d626-4f17-90a9-5d961e24f39c tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1500 microversion: 2.1 time: 1.432760 Dec 03 15:03:00.952702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 46/89] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:02:59 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1500 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:01.019760 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2f8813ed-843b-4004-8e42-8abf73fa498a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:01.022334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2f8813ed-843b-4004-8e42-8abf73fa498a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:01.034122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f8813ed-843b-4004-8e42-8abf73fa498a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:01.034879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f8813ed-843b-4004-8e42-8abf73fa498a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:01.036498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f8813ed-843b-4004-8e42-8abf73fa498a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:01.036883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f8813ed-843b-4004-8e42-8abf73fa498a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:01.098596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-f6676ca3-51d6-4c25-b9c0-f86b61a26ff7 req-03d493dd-2459-47ba-b201-60753cfdb2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5082cea-6dd3-41d3-9210-f5e8bd37f651", "tag": "e835912e-98c3-4b70-bf9b-467e0fcfcd78"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:01.106242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:01.106242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:01.124598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f6676ca3-51d6-4c25-b9c0-f86b61a26ff7 req-03d493dd-2459-47ba-b201-60753cfdb2e3 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:01.125469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f6676ca3-51d6-4c25-b9c0-f86b61a26ff7 req-03d493dd-2459-47ba-b201-60753cfdb2e3 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:01.148186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-f6676ca3-51d6-4c25-b9c0-f86b61a26ff7 req-03d493dd-2459-47ba-b201-60753cfdb2e3 service nova] Creating event network-changed:e835912e-98c3-4b70-bf9b-467e0fcfcd78 for instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 on hv-cinder-75790 Dec 03 15:03:01.155140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-f6676ca3-51d6-4c25-b9c0-f86b61a26ff7 req-03d493dd-2459-47ba-b201-60753cfdb2e3 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085116 Dec 03 15:03:01.156167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 47/90] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:01 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:01.712166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-41f7f1ea-ea81-4be8-a72f-1ffb77e79478 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:01.713056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-41f7f1ea-ea81-4be8-a72f-1ffb77e79478 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:01.728414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2f8813ed-843b-4004-8e42-8abf73fa498a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:01.736528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41f7f1ea-ea81-4be8-a72f-1ffb77e79478 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:01.737056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41f7f1ea-ea81-4be8-a72f-1ffb77e79478 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:01.737972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41f7f1ea-ea81-4be8-a72f-1ffb77e79478 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:01.739169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41f7f1ea-ea81-4be8-a72f-1ffb77e79478 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:01.740647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2f8813ed-843b-4004-8e42-8abf73fa498a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.732833 Dec 03 15:03:01.741450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 44/91] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:01 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:01.945890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:01.947531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:01.958845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:01.959508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:01.960660 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:01.961883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:02.089045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-41f7f1ea-ea81-4be8-a72f-1ffb77e79478 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:02.099853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-41f7f1ea-ea81-4be8-a72f-1ffb77e79478 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.406579 Dec 03 15:03:02.100977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 48/92] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:01 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:02.225124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:02.239723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:02.246231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:02.247930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-07c9dc86-af07-4357-afc1-8be542a408c4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.319454 Dec 03 15:03:02.248961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 45/93] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:01 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:02.766568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b634685e-6630-4bb1-b421-527fb913b2c0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:02.767234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b634685e-6630-4bb1-b421-527fb913b2c0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:02.775166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b634685e-6630-4bb1-b421-527fb913b2c0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:02.775668 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b634685e-6630-4bb1-b421-527fb913b2c0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:02.776681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b634685e-6630-4bb1-b421-527fb913b2c0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:02.777163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b634685e-6630-4bb1-b421-527fb913b2c0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:03.007260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b634685e-6630-4bb1-b421-527fb913b2c0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:03.017491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b634685e-6630-4bb1-b421-527fb913b2c0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.260449 Dec 03 15:03:03.018050 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 49/94] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:02 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:03.125681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5a1b3fac-92aa-4dce-8d2e-0a733e556eb7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:03.126371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5a1b3fac-92aa-4dce-8d2e-0a733e556eb7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:03.134458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5a1b3fac-92aa-4dce-8d2e-0a733e556eb7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:03.135004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5a1b3fac-92aa-4dce-8d2e-0a733e556eb7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:03.135852 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5a1b3fac-92aa-4dce-8d2e-0a733e556eb7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:03.136337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5a1b3fac-92aa-4dce-8d2e-0a733e556eb7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:03.194728 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-3276843a-816e-4d12-9141-d49757ec201b req-ba242c5b-b886-447f-9b62-e8097e141773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7b86d5-7e34-4b4e-9561-8540a0f0fa76", "tag": "933ad543-585e-4a97-b615-70b5dc2690fb"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:03.201580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:03.201580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:03.211160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-3276843a-816e-4d12-9141-d49757ec201b req-ba242c5b-b886-447f-9b62-e8097e141773 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:03.211662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-3276843a-816e-4d12-9141-d49757ec201b req-ba242c5b-b886-447f-9b62-e8097e141773 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:03.228962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-3276843a-816e-4d12-9141-d49757ec201b req-ba242c5b-b886-447f-9b62-e8097e141773 service nova] Creating event network-changed:933ad543-585e-4a97-b615-70b5dc2690fb for instance 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 on hv-cinder-75790 Dec 03 15:03:03.234841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-3276843a-816e-4d12-9141-d49757ec201b req-ba242c5b-b886-447f-9b62-e8097e141773 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050757 Dec 03 15:03:03.235683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 50/95] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:03 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:03:03.273426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:03.274450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:03.282770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:03.283373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:03.284347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:03.284935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:03.360934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5a1b3fac-92aa-4dce-8d2e-0a733e556eb7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:03.370106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5a1b3fac-92aa-4dce-8d2e-0a733e556eb7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.254653 Dec 03 15:03:03.370702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 46/96] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:03 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:03.523176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:03.538200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:03.545056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:03.546221 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-99abab68-2ed1-4bc8-8f17-564456816caa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.283197 Dec 03 15:03:03.546851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 51/97] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:03 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:03:04.043633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-816d5a71-c8cd-4a35-bee9-d025d3ca3eba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:04.046105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-816d5a71-c8cd-4a35-bee9-d025d3ca3eba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:04.058268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-816d5a71-c8cd-4a35-bee9-d025d3ca3eba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:04.059413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-816d5a71-c8cd-4a35-bee9-d025d3ca3eba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:04.061617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-816d5a71-c8cd-4a35-bee9-d025d3ca3eba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:04.062513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-816d5a71-c8cd-4a35-bee9-d025d3ca3eba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:04.394259 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-933c0681-f3e8-4f35-97c0-797ee90d1875 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:04.394728 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-933c0681-f3e8-4f35-97c0-797ee90d1875 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:04.402883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-933c0681-f3e8-4f35-97c0-797ee90d1875 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:04.404937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-933c0681-f3e8-4f35-97c0-797ee90d1875 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:04.405992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-933c0681-f3e8-4f35-97c0-797ee90d1875 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:04.406631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-933c0681-f3e8-4f35-97c0-797ee90d1875 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:04.494166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-816d5a71-c8cd-4a35-bee9-d025d3ca3eba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:04.504694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-816d5a71-c8cd-4a35-bee9-d025d3ca3eba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.473362 Dec 03 15:03:04.505281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 47/98] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:04 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:04.577959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:04.578635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:04.586547 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:04.587057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:04.588126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:04.588564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:04.948633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-933c0681-f3e8-4f35-97c0-797ee90d1875 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:04.960749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-933c0681-f3e8-4f35-97c0-797ee90d1875 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.575980 Dec 03 15:03:04.961985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 52/99] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:04 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:05.061095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:05.085634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:05.096448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:05.098336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7e9f2b33-6dfd-409b-a62c-45d9348052b7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.536266 Dec 03 15:03:05.109723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 48/100] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:04 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:03:05.324450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0953f3bc-3546-422b-850c-7c2bcb502efe tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55dee5f4-6a2a-4848-ba8e-4e3147e50517"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:05.326784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0953f3bc-3546-422b-850c-7c2bcb502efe tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:05.336741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0953f3bc-3546-422b-850c-7c2bcb502efe tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:05.337496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0953f3bc-3546-422b-850c-7c2bcb502efe tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:05.338533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0953f3bc-3546-422b-850c-7c2bcb502efe tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:05.339184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0953f3bc-3546-422b-850c-7c2bcb502efe tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:05.529401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2298987f-e8db-481f-8ad2-37faaafbdad0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:05.534250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2298987f-e8db-481f-8ad2-37faaafbdad0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:05.556253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2298987f-e8db-481f-8ad2-37faaafbdad0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:05.556781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2298987f-e8db-481f-8ad2-37faaafbdad0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:05.557703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2298987f-e8db-481f-8ad2-37faaafbdad0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:05.558217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2298987f-e8db-481f-8ad2-37faaafbdad0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:06.173636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0953f3bc-3546-422b-850c-7c2bcb502efe tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "POST /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860147 Dec 03 15:03:06.178473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 53/101] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:03:05 2020] POST /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:06.236393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-13573e53-af0c-42b6-89ab-0e79b09e0d76 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:06.239065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-13573e53-af0c-42b6-89ab-0e79b09e0d76 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:06.266512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13573e53-af0c-42b6-89ab-0e79b09e0d76 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:06.267906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13573e53-af0c-42b6-89ab-0e79b09e0d76 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:06.271062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13573e53-af0c-42b6-89ab-0e79b09e0d76 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:06.271684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13573e53-af0c-42b6-89ab-0e79b09e0d76 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:06.318594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2298987f-e8db-481f-8ad2-37faaafbdad0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:06.349479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2298987f-e8db-481f-8ad2-37faaafbdad0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.830366 Dec 03 15:03:06.353846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 49/102] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:05 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:06.406689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-d345a375-1c7c-44de-88c8-2d025f236745 req-dd85aee0-0775-4427-abff-abb78a6dcf72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53f7d53-2ae6-4edd-84c2-09e523498d7d", "tag": "6e8050ed-0789-4bcc-bbe2-11f953a2e2ed"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:06.425143 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:06.425143 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:06.447665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d345a375-1c7c-44de-88c8-2d025f236745 req-dd85aee0-0775-4427-abff-abb78a6dcf72 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:06.448166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d345a375-1c7c-44de-88c8-2d025f236745 req-dd85aee0-0775-4427-abff-abb78a6dcf72 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:06.526237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-d345a375-1c7c-44de-88c8-2d025f236745 req-dd85aee0-0775-4427-abff-abb78a6dcf72 service nova] Creating event network-changed:6e8050ed-0789-4bcc-bbe2-11f953a2e2ed for instance f53f7d53-2ae6-4edd-84c2-09e523498d7d on hv-cinder-75790 Dec 03 15:03:06.532378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-d345a375-1c7c-44de-88c8-2d025f236745 req-dd85aee0-0775-4427-abff-abb78a6dcf72 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166796 Dec 03 15:03:06.534977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 50/103] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:06 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:06.554971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:06.556003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:06.580428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:06.581220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:06.582570 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:06.583284 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:06.967785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:07.014459 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:07.038910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:07.043115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-86d8f9ac-128f-422d-82fd-4750c6677eff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.504828 Dec 03 15:03:07.043886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 51/104] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:06 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:07.220821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-13573e53-af0c-42b6-89ab-0e79b09e0d76 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:07.245247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-13573e53-af0c-42b6-89ab-0e79b09e0d76 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 1.037946 Dec 03 15:03:07.251018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 54/105] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:06 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:07.394862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-fbd20d1e-78df-4385-adf6-0eaca84d4eaa req-5f6b88aa-167a-48e8-89c0-4de3327003ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c233978f-9c32-47bf-8b66-44f0baa08830", "name": "network-vif-plugged", "status": "completed", "tag": "4fcc7ba2-ca25-407b-8386-4f72181d346e"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:07.398917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1bdd790d-f704-423e-81c7-ae54be1a6705 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:07.399615 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1bdd790d-f704-423e-81c7-ae54be1a6705 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:07.416785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:07.416785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:07.423215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1bdd790d-f704-423e-81c7-ae54be1a6705 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:07.423727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1bdd790d-f704-423e-81c7-ae54be1a6705 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:07.427704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1bdd790d-f704-423e-81c7-ae54be1a6705 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:07.428222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1bdd790d-f704-423e-81c7-ae54be1a6705 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:07.446173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-fbd20d1e-78df-4385-adf6-0eaca84d4eaa req-5f6b88aa-167a-48e8-89c0-4de3327003ca service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:07.452536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-fbd20d1e-78df-4385-adf6-0eaca84d4eaa req-5f6b88aa-167a-48e8-89c0-4de3327003ca service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:07.504180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-fbd20d1e-78df-4385-adf6-0eaca84d4eaa req-5f6b88aa-167a-48e8-89c0-4de3327003ca service nova] Creating event network-vif-plugged:4fcc7ba2-ca25-407b-8386-4f72181d346e for instance c233978f-9c32-47bf-8b66-44f0baa08830 on hv-cinder-75790 Dec 03 15:03:07.510228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-fbd20d1e-78df-4385-adf6-0eaca84d4eaa req-5f6b88aa-167a-48e8-89c0-4de3327003ca service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139974 Dec 03 15:03:07.511465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 55/106] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:07 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:08.081510 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:08.082619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:08.093688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:08.094406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:08.096005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:08.096709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:08.110593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1bdd790d-f704-423e-81c7-ae54be1a6705 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:08.132868 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1bdd790d-f704-423e-81c7-ae54be1a6705 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.765176 Dec 03 15:03:08.134089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 52/107] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:07 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:08.277808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c87a436c-3806-4f16-9705-2cd0295c77c3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:08.280684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c87a436c-3806-4f16-9705-2cd0295c77c3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:08.297247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c87a436c-3806-4f16-9705-2cd0295c77c3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:08.300571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c87a436c-3806-4f16-9705-2cd0295c77c3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:08.305651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c87a436c-3806-4f16-9705-2cd0295c77c3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:08.306601 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c87a436c-3806-4f16-9705-2cd0295c77c3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:08.405786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:08.431560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:08.439529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:08.441165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9b6aa857-b33d-4dd0-b489-4272d02efe82 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.379784 Dec 03 15:03:08.454027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 56/108] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:08 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:08.814672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c87a436c-3806-4f16-9705-2cd0295c77c3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:08.824110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c87a436c-3806-4f16-9705-2cd0295c77c3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.558362 Dec 03 15:03:08.824723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 53/109] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:08 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:09.160709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-34c850d8-9c11-4fad-a5f3-79b8e54541fa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:09.161584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-34c850d8-9c11-4fad-a5f3-79b8e54541fa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:09.170721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34c850d8-9c11-4fad-a5f3-79b8e54541fa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:09.171486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34c850d8-9c11-4fad-a5f3-79b8e54541fa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:09.172515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34c850d8-9c11-4fad-a5f3-79b8e54541fa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:09.173179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34c850d8-9c11-4fad-a5f3-79b8e54541fa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:09.423443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-34c850d8-9c11-4fad-a5f3-79b8e54541fa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:09.432569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-34c850d8-9c11-4fad-a5f3-79b8e54541fa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.281413 Dec 03 15:03:09.433359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 57/110] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:09 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:09.466816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:09.467891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:09.475809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:09.476328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:09.477189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:09.477686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:09.802586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:09.823358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:09.832553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:09.834417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9a84a668-208f-4db9-95fb-a7be1415bf50 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.377525 Dec 03 15:03:09.841363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 54/111] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:09 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:09.849616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8a31b50b-f848-48cb-893b-a6586ca90fb6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:09.850317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8a31b50b-f848-48cb-893b-a6586ca90fb6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:09.865231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8a31b50b-f848-48cb-893b-a6586ca90fb6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:09.865734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8a31b50b-f848-48cb-893b-a6586ca90fb6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:09.866575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8a31b50b-f848-48cb-893b-a6586ca90fb6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:09.867071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8a31b50b-f848-48cb-893b-a6586ca90fb6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:10.324573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8a31b50b-f848-48cb-893b-a6586ca90fb6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:10.339448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8a31b50b-f848-48cb-893b-a6586ca90fb6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.500859 Dec 03 15:03:10.345040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 58/112] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:09 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:10.461184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c5d22f41-f1c6-487a-b787-f81fb28430bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:10.462808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c5d22f41-f1c6-487a-b787-f81fb28430bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:10.476733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c5d22f41-f1c6-487a-b787-f81fb28430bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:10.477995 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c5d22f41-f1c6-487a-b787-f81fb28430bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:10.479224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c5d22f41-f1c6-487a-b787-f81fb28430bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:10.480223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c5d22f41-f1c6-487a-b787-f81fb28430bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:10.760176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c5d22f41-f1c6-487a-b787-f81fb28430bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:10.770373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c5d22f41-f1c6-487a-b787-f81fb28430bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.323539 Dec 03 15:03:10.771465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 55/113] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:10 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:10.860369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:10.861338 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:10.869844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:10.870617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:10.871650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:10.873047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:11.363898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:11.367161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4388ba32-f4fc-4ea5-bb1e-8ca255ca8304 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:11.367964 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4388ba32-f4fc-4ea5-bb1e-8ca255ca8304 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:11.376187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4388ba32-f4fc-4ea5-bb1e-8ca255ca8304 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:11.376843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4388ba32-f4fc-4ea5-bb1e-8ca255ca8304 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:11.378213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4388ba32-f4fc-4ea5-bb1e-8ca255ca8304 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:11.378814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4388ba32-f4fc-4ea5-bb1e-8ca255ca8304 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:11.381413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:11.389958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:11.391173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8cb04540-fbcb-4390-8969-e84f75720e1e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.541234 Dec 03 15:03:11.391974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 59/114] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:10 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:11.628594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4388ba32-f4fc-4ea5-bb1e-8ca255ca8304 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:11.639787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4388ba32-f4fc-4ea5-bb1e-8ca255ca8304 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.282830 Dec 03 15:03:11.641076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 56/115] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:11 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:11.797337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6b68c70b-370b-4d6b-bb05-aeb2b4ea8178 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:11.798513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6b68c70b-370b-4d6b-bb05-aeb2b4ea8178 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:11.816314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6b68c70b-370b-4d6b-bb05-aeb2b4ea8178 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:11.816827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6b68c70b-370b-4d6b-bb05-aeb2b4ea8178 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:11.817690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6b68c70b-370b-4d6b-bb05-aeb2b4ea8178 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:11.818220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6b68c70b-370b-4d6b-bb05-aeb2b4ea8178 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:12.415410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:12.416483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:12.425181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:12.426038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:12.427089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:12.427775 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:12.748454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:12.769003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:12.777656 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:12.779503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9ba45906-429d-4374-8ce4-5e072eefcf3e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.373159 Dec 03 15:03:12.780593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 57/116] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:12 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:12.792961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-57219360-01fd-4822-9855-517c24712020 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:12.794054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-57219360-01fd-4822-9855-517c24712020 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:12.804384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-57219360-01fd-4822-9855-517c24712020 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:12.805384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-57219360-01fd-4822-9855-517c24712020 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:12.806748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-57219360-01fd-4822-9855-517c24712020 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:12.807444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-57219360-01fd-4822-9855-517c24712020 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:13.197038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6b68c70b-370b-4d6b-bb05-aeb2b4ea8178 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:13.225170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6b68c70b-370b-4d6b-bb05-aeb2b4ea8178 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 1.439754 Dec 03 15:03:13.232954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 60/117] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:11 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:13.314456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-57219360-01fd-4822-9855-517c24712020 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:13.335084 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-57219360-01fd-4822-9855-517c24712020 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.552910 Dec 03 15:03:13.338642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 58/118] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:12 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:13.633882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-71c1f7ee-a5be-45d3-8c12-e474dcb3d126 req-1b90067d-4428-4bf7-a6eb-f9909157ecd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7b86d5-7e34-4b4e-9561-8540a0f0fa76", "name": "network-vif-plugged", "status": "completed", "tag": "933ad543-585e-4a97-b615-70b5dc2690fb"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:13.641478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:13.641478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:13.670530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-71c1f7ee-a5be-45d3-8c12-e474dcb3d126 req-1b90067d-4428-4bf7-a6eb-f9909157ecd7 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:13.674721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-71c1f7ee-a5be-45d3-8c12-e474dcb3d126 req-1b90067d-4428-4bf7-a6eb-f9909157ecd7 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:13.709231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-71c1f7ee-a5be-45d3-8c12-e474dcb3d126 req-1b90067d-4428-4bf7-a6eb-f9909157ecd7 service nova] Creating event network-vif-plugged:933ad543-585e-4a97-b615-70b5dc2690fb for instance 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 on hv-cinder-75790 Dec 03 15:03:13.724294 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-71c1f7ee-a5be-45d3-8c12-e474dcb3d126 req-1b90067d-4428-4bf7-a6eb-f9909157ecd7 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101204 Dec 03 15:03:13.725925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 61/119] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:13 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:13.817880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:13.819196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:13.828511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:13.829406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:13.830495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:13.831188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:14.164036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:14.182357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:14.190585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:14.191964 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a2d94606-4f8d-43d1-b684-f228cd14c766 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.392562 Dec 03 15:03:14.193029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 59/120] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:13 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:14.261375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6983d6a6-0be6-4c48-8853-6cb4d259d52c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:14.264260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6983d6a6-0be6-4c48-8853-6cb4d259d52c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:14.275141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6983d6a6-0be6-4c48-8853-6cb4d259d52c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:14.275881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6983d6a6-0be6-4c48-8853-6cb4d259d52c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:14.276844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6983d6a6-0be6-4c48-8853-6cb4d259d52c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:14.277414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6983d6a6-0be6-4c48-8853-6cb4d259d52c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:14.362517 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a9a4e2ee-6a1e-4979-9c18-6b0d34d6d295 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:14.363113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a9a4e2ee-6a1e-4979-9c18-6b0d34d6d295 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:14.379707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9a4e2ee-6a1e-4979-9c18-6b0d34d6d295 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:14.380220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9a4e2ee-6a1e-4979-9c18-6b0d34d6d295 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:14.381293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9a4e2ee-6a1e-4979-9c18-6b0d34d6d295 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:14.381658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9a4e2ee-6a1e-4979-9c18-6b0d34d6d295 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:14.574589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6983d6a6-0be6-4c48-8853-6cb4d259d52c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:14.596577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6983d6a6-0be6-4c48-8853-6cb4d259d52c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.346485 Dec 03 15:03:14.597866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 62/121] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:14 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:14.630386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a9a4e2ee-6a1e-4979-9c18-6b0d34d6d295 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:14.640217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a9a4e2ee-6a1e-4979-9c18-6b0d34d6d295 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.289960 Dec 03 15:03:14.641073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 60/122] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:14 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:15.217356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:15.218589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:15.226504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:15.227017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:15.227871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:15.228367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:15.492544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:15.508188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:15.514977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:15.516116 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-50fa1040-49e0-47fa-be2c-bc5f1a4caa32 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.308473 Dec 03 15:03:15.516701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 63/123] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:15 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:15.621848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c6126dbd-cf8f-4ee8-bb24-35b7f925b934 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:15.623005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c6126dbd-cf8f-4ee8-bb24-35b7f925b934 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:15.630975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c6126dbd-cf8f-4ee8-bb24-35b7f925b934 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:15.631421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c6126dbd-cf8f-4ee8-bb24-35b7f925b934 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:15.632254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c6126dbd-cf8f-4ee8-bb24-35b7f925b934 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:15.632788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c6126dbd-cf8f-4ee8-bb24-35b7f925b934 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:15.664507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-054dd084-44c3-42da-98a3-f5106f1348ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:15.665166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-054dd084-44c3-42da-98a3-f5106f1348ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:15.675160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-054dd084-44c3-42da-98a3-f5106f1348ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:15.675670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-054dd084-44c3-42da-98a3-f5106f1348ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:15.676514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-054dd084-44c3-42da-98a3-f5106f1348ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:15.677002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-054dd084-44c3-42da-98a3-f5106f1348ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:15.942471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-054dd084-44c3-42da-98a3-f5106f1348ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:15.945376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c6126dbd-cf8f-4ee8-bb24-35b7f925b934 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:15.953716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-054dd084-44c3-42da-98a3-f5106f1348ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.298130 Dec 03 15:03:15.954638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 64/124] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:15 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:15.966834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c6126dbd-cf8f-4ee8-bb24-35b7f925b934 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1322 microversion: 2.1 time: 0.350224 Dec 03 15:03:15.967942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 61/125] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:15 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:16.365002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-3aaeb4d6-2c68-42e9-a081-523e0dfc95fa req-38083853-ed3c-40b1-82cc-6755227007b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53f7d53-2ae6-4edd-84c2-09e523498d7d", "name": "network-vif-plugged", "status": "completed", "tag": "6e8050ed-0789-4bcc-bbe2-11f953a2e2ed"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:16.374314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:16.374314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:16.383445 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-3aaeb4d6-2c68-42e9-a081-523e0dfc95fa req-38083853-ed3c-40b1-82cc-6755227007b5 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:16.383928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-3aaeb4d6-2c68-42e9-a081-523e0dfc95fa req-38083853-ed3c-40b1-82cc-6755227007b5 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:16.405489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-3aaeb4d6-2c68-42e9-a081-523e0dfc95fa req-38083853-ed3c-40b1-82cc-6755227007b5 service nova] Creating event network-vif-plugged:6e8050ed-0789-4bcc-bbe2-11f953a2e2ed for instance f53f7d53-2ae6-4edd-84c2-09e523498d7d on hv-cinder-75790 Dec 03 15:03:16.411525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-3aaeb4d6-2c68-42e9-a081-523e0dfc95fa req-38083853-ed3c-40b1-82cc-6755227007b5 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056632 Dec 03 15:03:16.412130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 65/126] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:16 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:16.543623 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:16.544607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:16.564318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:16.567216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:16.568339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:16.579743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:16.980020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a26f6601-925d-4a75-bf52-b2cf48ad361e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:16.981045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a26f6601-925d-4a75-bf52-b2cf48ad361e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:16.990269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a26f6601-925d-4a75-bf52-b2cf48ad361e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:16.990878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a26f6601-925d-4a75-bf52-b2cf48ad361e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:16.991800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a26f6601-925d-4a75-bf52-b2cf48ad361e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:16.992496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a26f6601-925d-4a75-bf52-b2cf48ad361e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:17.052663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:17.070164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:17.078345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:17.094271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-84591918-4134-408f-837a-46a9e1e85c1d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.548086 Dec 03 15:03:17.095696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 62/127] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:16 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:17.110969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5e0ebab2-a834-440a-8086-34762b3b58b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:17.112146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5e0ebab2-a834-440a-8086-34762b3b58b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:17.120747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e0ebab2-a834-440a-8086-34762b3b58b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:17.121582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e0ebab2-a834-440a-8086-34762b3b58b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:17.123269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e0ebab2-a834-440a-8086-34762b3b58b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:17.123967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e0ebab2-a834-440a-8086-34762b3b58b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:17.252217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a26f6601-925d-4a75-bf52-b2cf48ad361e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:17.267326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a26f6601-925d-4a75-bf52-b2cf48ad361e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.297977 Dec 03 15:03:17.268069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 66/128] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:16 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:17.371912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5e0ebab2-a834-440a-8086-34762b3b58b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:17.384384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5e0ebab2-a834-440a-8086-34762b3b58b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1516 microversion: 2.1 time: 0.287277 Dec 03 15:03:17.384992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 63/129] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:17 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:17.412710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-52a00c4f-83a5-4248-946d-47863779018c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:17.413819 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-52a00c4f-83a5-4248-946d-47863779018c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:17.422348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-52a00c4f-83a5-4248-946d-47863779018c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:17.422857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-52a00c4f-83a5-4248-946d-47863779018c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:17.423714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-52a00c4f-83a5-4248-946d-47863779018c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:17.424227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-52a00c4f-83a5-4248-946d-47863779018c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:17.496374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-52a00c4f-83a5-4248-946d-47863779018c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lazy-loading 'flavor' on Instance uuid 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:03:17.650631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-52a00c4f-83a5-4248-946d-47863779018c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76/action" status: 200 len: 32 microversion: 2.1 time: 0.249332 Dec 03 15:03:17.651295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 67/130] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:17 2020] POST /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:03:17.667029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-522dcef9-1663-42e0-8bec-a74b713195de tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:17.667694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-522dcef9-1663-42e0-8bec-a74b713195de tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:17.675543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-522dcef9-1663-42e0-8bec-a74b713195de tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:17.676042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-522dcef9-1663-42e0-8bec-a74b713195de tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:17.676956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-522dcef9-1663-42e0-8bec-a74b713195de tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:17.677500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-522dcef9-1663-42e0-8bec-a74b713195de tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:17.910119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-522dcef9-1663-42e0-8bec-a74b713195de tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:17.916206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-522dcef9-1663-42e0-8bec-a74b713195de tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.258352 Dec 03 15:03:17.916769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 64/131] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:17 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:18.119903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:18.120674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:18.135891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:18.136728 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:18.138502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:18.139308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:18.290305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a084bb5a-9bb0-4359-99ef-78837a2481ce tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:18.290967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a084bb5a-9bb0-4359-99ef-78837a2481ce tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:18.300107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a084bb5a-9bb0-4359-99ef-78837a2481ce tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:18.300625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a084bb5a-9bb0-4359-99ef-78837a2481ce tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:18.301479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a084bb5a-9bb0-4359-99ef-78837a2481ce tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:18.302038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a084bb5a-9bb0-4359-99ef-78837a2481ce tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:18.383674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:18.398746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:18.405719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:18.406910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ce94835b-e2fc-4432-ae70-a000cd4c229a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.296856 Dec 03 15:03:18.407490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 68/132] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:18 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:18.455862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-26ba496f-a937-414b-9239-dea397709940 req-0c81419f-ab95-4bf7-a6c5-af31cf125aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5082cea-6dd3-41d3-9210-f5e8bd37f651", "name": "network-vif-plugged", "status": "completed", "tag": "e835912e-98c3-4b70-bf9b-467e0fcfcd78"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:18.462462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:18.462462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:18.472417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-26ba496f-a937-414b-9239-dea397709940 req-0c81419f-ab95-4bf7-a6c5-af31cf125aae service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:18.472917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-26ba496f-a937-414b-9239-dea397709940 req-0c81419f-ab95-4bf7-a6c5-af31cf125aae service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:18.490916 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-26ba496f-a937-414b-9239-dea397709940 req-0c81419f-ab95-4bf7-a6c5-af31cf125aae service nova] Creating event network-vif-plugged:e835912e-98c3-4b70-bf9b-467e0fcfcd78 for instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 on hv-cinder-75790 Dec 03 15:03:18.496021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-26ba496f-a937-414b-9239-dea397709940 req-0c81419f-ab95-4bf7-a6c5-af31cf125aae service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049660 Dec 03 15:03:18.496898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 69/133] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:18 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:03:18.534708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a084bb5a-9bb0-4359-99ef-78837a2481ce tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:18.543387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a084bb5a-9bb0-4359-99ef-78837a2481ce tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.262158 Dec 03 15:03:18.544569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 65/134] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:18 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:18.941620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-15e80c96-e7e4-4e4a-bf54-0252a507bfdd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:18.942464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-15e80c96-e7e4-4e4a-bf54-0252a507bfdd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:18.951878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15e80c96-e7e4-4e4a-bf54-0252a507bfdd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:18.952370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15e80c96-e7e4-4e4a-bf54-0252a507bfdd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:18.953209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15e80c96-e7e4-4e4a-bf54-0252a507bfdd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:18.954005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15e80c96-e7e4-4e4a-bf54-0252a507bfdd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:19.186343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-15e80c96-e7e4-4e4a-bf54-0252a507bfdd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:19.195551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-15e80c96-e7e4-4e4a-bf54-0252a507bfdd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.264469 Dec 03 15:03:19.196166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 70/135] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:18 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:19.438493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:19.439164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:19.446993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:19.447507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:19.448346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:19.448843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:19.567200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-014835ff-3a4b-468c-9731-04bb385626cf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:19.568105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-014835ff-3a4b-468c-9731-04bb385626cf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:19.577094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-014835ff-3a4b-468c-9731-04bb385626cf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:19.577597 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-014835ff-3a4b-468c-9731-04bb385626cf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:19.578473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-014835ff-3a4b-468c-9731-04bb385626cf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:19.578958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-014835ff-3a4b-468c-9731-04bb385626cf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:19.695001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:19.710227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:19.717676 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:19.718789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-450e0eb4-d7c7-400a-bb5a-e9923675d0bc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.290003 Dec 03 15:03:19.719553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 66/136] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:19 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:19.990870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-014835ff-3a4b-468c-9731-04bb385626cf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:20.000373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-014835ff-3a4b-468c-9731-04bb385626cf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.442633 Dec 03 15:03:20.000989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 71/137] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:19 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:20.218255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-84589254-6458-4f0d-8e81-4343f2dd1c1f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:20.218928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-84589254-6458-4f0d-8e81-4343f2dd1c1f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:20.227038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84589254-6458-4f0d-8e81-4343f2dd1c1f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:20.227588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84589254-6458-4f0d-8e81-4343f2dd1c1f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:20.228483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84589254-6458-4f0d-8e81-4343f2dd1c1f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:20.228977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84589254-6458-4f0d-8e81-4343f2dd1c1f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:20.471763 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-84589254-6458-4f0d-8e81-4343f2dd1c1f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:20.482383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-84589254-6458-4f0d-8e81-4343f2dd1c1f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.272465 Dec 03 15:03:20.483255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 67/138] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:20 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:20.751507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:20.752568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:20.761843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:20.763063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:20.764240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:20.764933 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:21.024407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-25bdcd55-8e35-430b-a26f-089d0f1785dc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:21.027473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-25bdcd55-8e35-430b-a26f-089d0f1785dc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:21.049390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-25bdcd55-8e35-430b-a26f-089d0f1785dc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:21.050295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-25bdcd55-8e35-430b-a26f-089d0f1785dc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:21.051408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-25bdcd55-8e35-430b-a26f-089d0f1785dc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:21.052210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-25bdcd55-8e35-430b-a26f-089d0f1785dc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:21.318525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:21.347122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:21.370264 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:21.374963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ce24bd10-2298-4319-841c-74df557620e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.641693 Dec 03 15:03:21.375807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 72/139] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:20 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:21.498855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-25bdcd55-8e35-430b-a26f-089d0f1785dc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:21.509415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-074f95b0-5086-4f99-b2eb-9251f3824428 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:21.516275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-074f95b0-5086-4f99-b2eb-9251f3824428 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:21.520625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-25bdcd55-8e35-430b-a26f-089d0f1785dc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1364 microversion: 2.1 time: 0.505334 Dec 03 15:03:21.521893 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 68/140] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:21 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1364 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:21.530341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-074f95b0-5086-4f99-b2eb-9251f3824428 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:21.530944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-074f95b0-5086-4f99-b2eb-9251f3824428 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:21.532051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-074f95b0-5086-4f99-b2eb-9251f3824428 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:21.532722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-074f95b0-5086-4f99-b2eb-9251f3824428 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:21.927262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-074f95b0-5086-4f99-b2eb-9251f3824428 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:21.940567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-074f95b0-5086-4f99-b2eb-9251f3824428 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.443461 Dec 03 15:03:21.941847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 73/141] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:21 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:22.405493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:22.407125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:22.416827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:22.417931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:22.419332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:22.420432 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:22.551089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7df4d0b1-9a16-4d99-915e-f220bbfd5c1f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:22.551522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7df4d0b1-9a16-4d99-915e-f220bbfd5c1f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:22.574713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7df4d0b1-9a16-4d99-915e-f220bbfd5c1f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:22.574713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7df4d0b1-9a16-4d99-915e-f220bbfd5c1f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:22.576294 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7df4d0b1-9a16-4d99-915e-f220bbfd5c1f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:22.577162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7df4d0b1-9a16-4d99-915e-f220bbfd5c1f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:22.764388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:22.789686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:22.798070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:22.799687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-60f2170a-6e18-4e7e-ad6a-4f697553e300 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1406 microversion: 2.20 time: 0.405023 Dec 03 15:03:22.809998 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 69/142] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:22 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:03:22.951960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7df4d0b1-9a16-4d99-915e-f220bbfd5c1f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:22.964602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7df4d0b1-9a16-4d99-915e-f220bbfd5c1f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1551 microversion: 2.1 time: 0.428670 Dec 03 15:03:22.966501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 74/143] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:22 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1551 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:22.985405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f3081579-6e33-4e58-bd1a-00756a7c6015 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:22.986909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f3081579-6e33-4e58-bd1a-00756a7c6015 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:22.989507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2fe3a153-1e17-4aa7-b97f-97612bc2caea tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:22.990084 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2fe3a153-1e17-4aa7-b97f-97612bc2caea tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:22.995815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3081579-6e33-4e58-bd1a-00756a7c6015 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:22.997442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3081579-6e33-4e58-bd1a-00756a7c6015 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:22.999393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2fe3a153-1e17-4aa7-b97f-97612bc2caea tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.000361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2fe3a153-1e17-4aa7-b97f-97612bc2caea tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:23.002014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2fe3a153-1e17-4aa7-b97f-97612bc2caea tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.002919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2fe3a153-1e17-4aa7-b97f-97612bc2caea tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:23.004734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3081579-6e33-4e58-bd1a-00756a7c6015 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.005793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3081579-6e33-4e58-bd1a-00756a7c6015 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:23.080361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2fe3a153-1e17-4aa7-b97f-97612bc2caea tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:03:23.253836 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2fe3a153-1e17-4aa7-b97f-97612bc2caea tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "DELETE /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 204 len: 0 microversion: 2.1 time: 0.271027 Dec 03 15:03:23.257583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 75/144] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:03:22 2020] DELETE /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:03:23.277145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9b6faac2-a85b-4368-b053-2da6541f47d2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:23.277799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9b6faac2-a85b-4368-b053-2da6541f47d2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:23.279320 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f3081579-6e33-4e58-bd1a-00756a7c6015 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:23.289870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b6faac2-a85b-4368-b053-2da6541f47d2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.289870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b6faac2-a85b-4368-b053-2da6541f47d2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:23.290764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f3081579-6e33-4e58-bd1a-00756a7c6015 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.332695 Dec 03 15:03:23.290882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b6faac2-a85b-4368-b053-2da6541f47d2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.291260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b6faac2-a85b-4368-b053-2da6541f47d2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:23.301422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 70/145] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:22 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:23.314683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9df6d97e-4de3-4578-82c5-1a5653d4689f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:23.317242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9df6d97e-4de3-4578-82c5-1a5653d4689f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:23.329592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9df6d97e-4de3-4578-82c5-1a5653d4689f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.330500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9df6d97e-4de3-4578-82c5-1a5653d4689f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:23.332107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9df6d97e-4de3-4578-82c5-1a5653d4689f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.332597 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9df6d97e-4de3-4578-82c5-1a5653d4689f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:23.585440 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9df6d97e-4de3-4578-82c5-1a5653d4689f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:23.597099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9df6d97e-4de3-4578-82c5-1a5653d4689f tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1552 microversion: 2.1 time: 0.303620 Dec 03 15:03:23.598395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 71/146] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:23 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1552 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:23.708761 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9b6faac2-a85b-4368-b053-2da6541f47d2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.449613 Dec 03 15:03:23.716047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 76/147] 10.222.0.63 () {58 vars in 1265 bytes} [Thu Dec 3 15:03:23 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/os-interface => generated 285 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:23.831613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:23.832298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:23.854555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.858960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:23.859996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:23.863592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:24.244394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:24.263010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:24.270211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:24.271608 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b502a983-4434-4daa-bc2a-08f2d3606537 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1598 microversion: 2.20 time: 0.455900 Dec 03 15:03:24.272172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 72/148] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:03:23 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1598 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:03:24.299160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e6c18ea6-54ad-4ed3-9ce3-83bc5bbc41fb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:24.299962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e6c18ea6-54ad-4ed3-9ce3-83bc5bbc41fb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:24.313484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6c18ea6-54ad-4ed3-9ce3-83bc5bbc41fb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:24.314825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d06b9473-4325-412a-9860-efc0cf9add13 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:24.315531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d06b9473-4325-412a-9860-efc0cf9add13 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:24.315935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6c18ea6-54ad-4ed3-9ce3-83bc5bbc41fb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:24.317262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6c18ea6-54ad-4ed3-9ce3-83bc5bbc41fb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:24.318897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6c18ea6-54ad-4ed3-9ce3-83bc5bbc41fb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:24.323356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d06b9473-4325-412a-9860-efc0cf9add13 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:24.323867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d06b9473-4325-412a-9860-efc0cf9add13 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:24.324715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d06b9473-4325-412a-9860-efc0cf9add13 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:24.326065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d06b9473-4325-412a-9860-efc0cf9add13 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:24.791973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d06b9473-4325-412a-9860-efc0cf9add13 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:24.803475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d06b9473-4325-412a-9860-efc0cf9add13 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.497980 Dec 03 15:03:24.804877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 73/149] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:24 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:24.809024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e6c18ea6-54ad-4ed3-9ce3-83bc5bbc41fb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.519552 Dec 03 15:03:24.810248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 77/150] 10.222.0.63 () {60 vars in 1306 bytes} [Thu Dec 3 15:03:24 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/os-interface => generated 284 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:03:24.825967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-66b1dfa3-7204-4764-8cb0-8fee17233b32 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:24.827019 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-66b1dfa3-7204-4764-8cb0-8fee17233b32 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:24.835631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66b1dfa3-7204-4764-8cb0-8fee17233b32 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:24.836376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66b1dfa3-7204-4764-8cb0-8fee17233b32 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:24.837448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66b1dfa3-7204-4764-8cb0-8fee17233b32 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:24.838294 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66b1dfa3-7204-4764-8cb0-8fee17233b32 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:25.722436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-66b1dfa3-7204-4764-8cb0-8fee17233b32 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:25.738283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-66b1dfa3-7204-4764-8cb0-8fee17233b32 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1552 microversion: 2.1 time: 0.931449 Dec 03 15:03:25.740045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 74/151] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:24 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1552 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:25.829620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9a7b6688-3ee3-441b-9d30-9b71e39faf7d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:25.830911 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9a7b6688-3ee3-441b-9d30-9b71e39faf7d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:25.839129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a7b6688-3ee3-441b-9d30-9b71e39faf7d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:25.840089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a7b6688-3ee3-441b-9d30-9b71e39faf7d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:25.841767 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a7b6688-3ee3-441b-9d30-9b71e39faf7d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:25.842521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a7b6688-3ee3-441b-9d30-9b71e39faf7d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:26.475102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-035e4a8b-03de-4c5d-a60c-b98af3781052 req-ce3d871e-5766-481d-9c63-afeb886b6227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df8e3bd-8dd7-4ac4-9409-df9187c8a651", "name": "network-vif-unplugged", "status": "completed", "tag": "25ef8b7b-be10-454b-bfbd-bfa8f9585236"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:26.493936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:26.493936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:26.515325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-035e4a8b-03de-4c5d-a60c-b98af3781052 req-ce3d871e-5766-481d-9c63-afeb886b6227 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:26.519717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-035e4a8b-03de-4c5d-a60c-b98af3781052 req-ce3d871e-5766-481d-9c63-afeb886b6227 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:26.567084 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-035e4a8b-03de-4c5d-a60c-b98af3781052 req-ce3d871e-5766-481d-9c63-afeb886b6227 service nova] Creating event network-vif-unplugged:25ef8b7b-be10-454b-bfbd-bfa8f9585236 for instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 on hv-cinder-75790 Dec 03 15:03:26.592253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-035e4a8b-03de-4c5d-a60c-b98af3781052 req-ce3d871e-5766-481d-9c63-afeb886b6227 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132867 Dec 03 15:03:26.593413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 75/152] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:26 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:26.765376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cf2c2b55-c7cf-43e0-8515-305e9f720d04 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:26.766773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cf2c2b55-c7cf-43e0-8515-305e9f720d04 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:26.781646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf2c2b55-c7cf-43e0-8515-305e9f720d04 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:26.782406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf2c2b55-c7cf-43e0-8515-305e9f720d04 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:26.783576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf2c2b55-c7cf-43e0-8515-305e9f720d04 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:26.784242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf2c2b55-c7cf-43e0-8515-305e9f720d04 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:27.010381 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9a7b6688-3ee3-441b-9d30-9b71e39faf7d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:27.027441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9a7b6688-3ee3-441b-9d30-9b71e39faf7d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 1.205914 Dec 03 15:03:27.030000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 78/153] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:25 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:27.299157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cf2c2b55-c7cf-43e0-8515-305e9f720d04 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:27.310167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cf2c2b55-c7cf-43e0-8515-305e9f720d04 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1552 microversion: 2.1 time: 0.556267 Dec 03 15:03:27.321137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 76/154] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:26 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1552 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:03:27.772800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1e20a050-ee52-4a5a-9f1b-a2e3c792c1f2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:27.788286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1e20a050-ee52-4a5a-9f1b-a2e3c792c1f2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:27.796936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e20a050-ee52-4a5a-9f1b-a2e3c792c1f2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:27.797447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e20a050-ee52-4a5a-9f1b-a2e3c792c1f2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:27.799956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e20a050-ee52-4a5a-9f1b-a2e3c792c1f2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:27.800473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e20a050-ee52-4a5a-9f1b-a2e3c792c1f2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:27.822516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-d67dc61f-2dfb-4f0b-a6a0-f5008ecf96dd req-f51d790e-47d8-45a6-ac8e-fce0d48f7a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5082cea-6dd3-41d3-9210-f5e8bd37f651", "tag": "e835912e-98c3-4b70-bf9b-467e0fcfcd78"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:27.832573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:27.832573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:27.863076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d67dc61f-2dfb-4f0b-a6a0-f5008ecf96dd req-f51d790e-47d8-45a6-ac8e-fce0d48f7a17 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:27.867764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d67dc61f-2dfb-4f0b-a6a0-f5008ecf96dd req-f51d790e-47d8-45a6-ac8e-fce0d48f7a17 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:27.914657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-d67dc61f-2dfb-4f0b-a6a0-f5008ecf96dd req-f51d790e-47d8-45a6-ac8e-fce0d48f7a17 service nova] Creating event network-changed:e835912e-98c3-4b70-bf9b-467e0fcfcd78 for instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 on hv-cinder-75790 Dec 03 15:03:27.926462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-d67dc61f-2dfb-4f0b-a6a0-f5008ecf96dd req-f51d790e-47d8-45a6-ac8e-fce0d48f7a17 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113219 Dec 03 15:03:27.934894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 77/155] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:27 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:28.042689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1e20a050-ee52-4a5a-9f1b-a2e3c792c1f2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 14 microversion: 2.1 time: 0.279932 Dec 03 15:03:28.047308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 79/156] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:27 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 14 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:03:28.062836 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-32678baa-4f72-44f9-bc1e-2ee35c725b66 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:28.063620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-32678baa-4f72-44f9-bc1e-2ee35c725b66 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:28.077643 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4455b2e7-a8c3-450a-bc5c-26b497c1b3e8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:28.079008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4455b2e7-a8c3-450a-bc5c-26b497c1b3e8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:28.081715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-32678baa-4f72-44f9-bc1e-2ee35c725b66 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:28.083721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-32678baa-4f72-44f9-bc1e-2ee35c725b66 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:28.084625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-32678baa-4f72-44f9-bc1e-2ee35c725b66 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:28.085124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-32678baa-4f72-44f9-bc1e-2ee35c725b66 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:28.096441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4455b2e7-a8c3-450a-bc5c-26b497c1b3e8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:28.096957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4455b2e7-a8c3-450a-bc5c-26b497c1b3e8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:28.097834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4455b2e7-a8c3-450a-bc5c-26b497c1b3e8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:28.098380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4455b2e7-a8c3-450a-bc5c-26b497c1b3e8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:28.335973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4455b2e7-a8c3-450a-bc5c-26b497c1b3e8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 14 microversion: 2.20 time: 0.273510 Dec 03 15:03:28.337003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 80/157] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:28 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:28.355613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-e4eae84c-34a4-4ce6-9966-77240495d3ff req-04cf1896-12ae-4419-a1af-17385c7a1743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53f7d53-2ae6-4edd-84c2-09e523498d7d", "tag": "6e8050ed-0789-4bcc-bbe2-11f953a2e2ed"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:28.374138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:28.374138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:28.394175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-e4eae84c-34a4-4ce6-9966-77240495d3ff req-04cf1896-12ae-4419-a1af-17385c7a1743 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:28.394938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-e4eae84c-34a4-4ce6-9966-77240495d3ff req-04cf1896-12ae-4419-a1af-17385c7a1743 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:28.413573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-e4eae84c-34a4-4ce6-9966-77240495d3ff req-04cf1896-12ae-4419-a1af-17385c7a1743 service nova] Creating event network-changed:6e8050ed-0789-4bcc-bbe2-11f953a2e2ed for instance f53f7d53-2ae6-4edd-84c2-09e523498d7d on hv-cinder-75790 Dec 03 15:03:28.419525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-e4eae84c-34a4-4ce6-9966-77240495d3ff req-04cf1896-12ae-4419-a1af-17385c7a1743 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080700 Dec 03 15:03:28.420830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 81/158] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:28 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:28.436972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8c83871d-1cd3-4f76-9a63-8845b095fb95 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:28.440665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8c83871d-1cd3-4f76-9a63-8845b095fb95 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:28.459127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c83871d-1cd3-4f76-9a63-8845b095fb95 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:28.462619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c83871d-1cd3-4f76-9a63-8845b095fb95 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:28.463742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c83871d-1cd3-4f76-9a63-8845b095fb95 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:28.464733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c83871d-1cd3-4f76-9a63-8845b095fb95 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:29.011853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8c83871d-1cd3-4f76-9a63-8845b095fb95 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:29.031872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8c83871d-1cd3-4f76-9a63-8845b095fb95 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1510 microversion: 2.1 time: 0.609523 Dec 03 15:03:29.039403 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 82/159] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:28 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:29.061426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-954aa61c-93eb-4dc2-b44d-69579848617e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:29.070655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-954aa61c-93eb-4dc2-b44d-69579848617e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:29.092073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-954aa61c-93eb-4dc2-b44d-69579848617e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:29.092960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-954aa61c-93eb-4dc2-b44d-69579848617e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:29.094080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-954aa61c-93eb-4dc2-b44d-69579848617e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:29.094767 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-954aa61c-93eb-4dc2-b44d-69579848617e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:29.304650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-32678baa-4f72-44f9-bc1e-2ee35c725b66 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:29.327464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-32678baa-4f72-44f9-bc1e-2ee35c725b66 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 1.283598 Dec 03 15:03:29.328605 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 78/160] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:28 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:29.345442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-954aa61c-93eb-4dc2-b44d-69579848617e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 14 microversion: 2.1 time: 0.294523 Dec 03 15:03:29.350195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 83/161] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:29 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 14 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:03:29.367481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6e1fddd2-bf23-4644-9991-f842e23f053d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:29.368568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6e1fddd2-bf23-4644-9991-f842e23f053d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:29.388370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e1fddd2-bf23-4644-9991-f842e23f053d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:29.388886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e1fddd2-bf23-4644-9991-f842e23f053d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:29.390222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e1fddd2-bf23-4644-9991-f842e23f053d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:29.390713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e1fddd2-bf23-4644-9991-f842e23f053d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:29.696494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6e1fddd2-bf23-4644-9991-f842e23f053d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 14 microversion: 2.20 time: 0.351473 Dec 03 15:03:29.700126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 79/162] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:29 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 14 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:30.042034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-0ed6b560-6742-443d-ae24-380965295c1a req-67924d34-3741-4b29-ac16-3967eac72c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df8e3bd-8dd7-4ac4-9409-df9187c8a651", "name": "network-vif-deleted", "tag": "25ef8b7b-be10-454b-bfbd-bfa8f9585236"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:30.049568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:03:30.049568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:03:30.072638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ea9e9374-672c-40fb-b515-4a03e7bc196b tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:30.079725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ea9e9374-672c-40fb-b515-4a03e7bc196b tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:30.092800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-0ed6b560-6742-443d-ae24-380965295c1a req-67924d34-3741-4b29-ac16-3967eac72c9e service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:30.102914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-0ed6b560-6742-443d-ae24-380965295c1a req-67924d34-3741-4b29-ac16-3967eac72c9e service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:30.120673 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea9e9374-672c-40fb-b515-4a03e7bc196b tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:30.124516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea9e9374-672c-40fb-b515-4a03e7bc196b tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:30.127365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea9e9374-672c-40fb-b515-4a03e7bc196b tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:30.129320 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea9e9374-672c-40fb-b515-4a03e7bc196b tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:30.151030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-0ed6b560-6742-443d-ae24-380965295c1a req-67924d34-3741-4b29-ac16-3967eac72c9e service nova] Creating event network-vif-deleted:25ef8b7b-be10-454b-bfbd-bfa8f9585236 for instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 on hv-cinder-75790 Dec 03 15:03:30.173464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-0ed6b560-6742-443d-ae24-380965295c1a req-67924d34-3741-4b29-ac16-3967eac72c9e service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144431 Dec 03 15:03:30.177546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 84/163] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:03:30 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:03:30.359063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b8d14c0c-0a28-4ade-b9fb-b1157d61023b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:30.366807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b8d14c0c-0a28-4ade-b9fb-b1157d61023b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:30.393840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b8d14c0c-0a28-4ade-b9fb-b1157d61023b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:30.395696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b8d14c0c-0a28-4ade-b9fb-b1157d61023b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:30.404249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b8d14c0c-0a28-4ade-b9fb-b1157d61023b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:30.405150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b8d14c0c-0a28-4ade-b9fb-b1157d61023b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:30.592154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ea9e9374-672c-40fb-b515-4a03e7bc196b tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a9312880714eda8e1983a2190cd32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b1a509fdae412992f73a7d46115cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:30.636282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ea9e9374-672c-40fb-b515-4a03e7bc196b tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 200 len: 1345 microversion: 2.1 time: 0.583076 Dec 03 15:03:30.636924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 80/164] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:30 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 1345 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:30.665230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-33cb7d88-d97b-4af6-ae1a-6ddefc79c943 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:30.666466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-33cb7d88-d97b-4af6-ae1a-6ddefc79c943 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:30.688292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-33cb7d88-d97b-4af6-ae1a-6ddefc79c943 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:30.688807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-33cb7d88-d97b-4af6-ae1a-6ddefc79c943 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:30.689664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-33cb7d88-d97b-4af6-ae1a-6ddefc79c943 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:30.690211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-33cb7d88-d97b-4af6-ae1a-6ddefc79c943 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:30.934957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-33cb7d88-d97b-4af6-ae1a-6ddefc79c943 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 14 microversion: 2.1 time: 0.293642 Dec 03 15:03:30.936917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 81/165] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:30 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 14 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:03:30.971165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a188b5b4-7723-4eaa-950f-04645abe810b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:30.974361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a188b5b4-7723-4eaa-950f-04645abe810b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:30.999969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a188b5b4-7723-4eaa-950f-04645abe810b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:31.000677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a188b5b4-7723-4eaa-950f-04645abe810b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:31.001851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a188b5b4-7723-4eaa-950f-04645abe810b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:31.002454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a188b5b4-7723-4eaa-950f-04645abe810b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:31.289370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a188b5b4-7723-4eaa-950f-04645abe810b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 14 microversion: 2.20 time: 0.350763 Dec 03 15:03:31.291029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 82/166] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:30 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 14 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:31.362815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b8d14c0c-0a28-4ade-b9fb-b1157d61023b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:31.390766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b8d14c0c-0a28-4ade-b9fb-b1157d61023b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 1.048556 Dec 03 15:03:31.412788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 85/167] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:30 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:31.670921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:31.676797 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:31.688582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:31.689830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:31.692060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:31.693111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:31.806524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] HTTP exception thrown: Instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 could not be found. Dec 03 15:03:31.807547 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Returning 404 to user: Instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:03:31.809732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-23aa95da-d5a1-4cb0-8001-e5a33415ff39 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 404 len: 111 microversion: 2.1 time: 0.158875 Dec 03 15:03:31.814311 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 83/168] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:31 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:03:31.956040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-77f8f642-0343-4cba-a95a-1838d0d6ae0c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:31.957476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-77f8f642-0343-4cba-a95a-1838d0d6ae0c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:31.971127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-77f8f642-0343-4cba-a95a-1838d0d6ae0c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:31.971635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-77f8f642-0343-4cba-a95a-1838d0d6ae0c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:31.972552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-77f8f642-0343-4cba-a95a-1838d0d6ae0c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:31.975272 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-77f8f642-0343-4cba-a95a-1838d0d6ae0c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:32.136144 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-77f8f642-0343-4cba-a95a-1838d0d6ae0c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 14 microversion: 2.1 time: 0.191570 Dec 03 15:03:32.144373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 86/169] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:31 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:03:32.308065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d7a9dc0b-92ff-4b74-b4a9-b2af546770be tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:32.310350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d7a9dc0b-92ff-4b74-b4a9-b2af546770be tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:32.320151 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d7a9dc0b-92ff-4b74-b4a9-b2af546770be tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:32.320866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d7a9dc0b-92ff-4b74-b4a9-b2af546770be tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:32.322375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d7a9dc0b-92ff-4b74-b4a9-b2af546770be tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:32.323079 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d7a9dc0b-92ff-4b74-b4a9-b2af546770be tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:32.415115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e412fcb9-2d5d-4104-b1a3-942bf7b0d90a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:32.415898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e412fcb9-2d5d-4104-b1a3-942bf7b0d90a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:32.425788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e412fcb9-2d5d-4104-b1a3-942bf7b0d90a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:32.426337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e412fcb9-2d5d-4104-b1a3-942bf7b0d90a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:32.427169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e412fcb9-2d5d-4104-b1a3-942bf7b0d90a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:32.427905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e412fcb9-2d5d-4104-b1a3-942bf7b0d90a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:32.470899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d7a9dc0b-92ff-4b74-b4a9-b2af546770be tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 14 microversion: 2.20 time: 0.172240 Dec 03 15:03:32.474638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 84/170] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:32 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:03:32.811197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e412fcb9-2d5d-4104-b1a3-942bf7b0d90a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:32.821316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e412fcb9-2d5d-4104-b1a3-942bf7b0d90a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.416139 Dec 03 15:03:32.832220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 87/171] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:32 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:03:33.162075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-57b5e2c9-cff4-4f3d-a2e3-dd388abf0d27 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:33.168076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-57b5e2c9-cff4-4f3d-a2e3-dd388abf0d27 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:33.211390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-57b5e2c9-cff4-4f3d-a2e3-dd388abf0d27 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.211903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-57b5e2c9-cff4-4f3d-a2e3-dd388abf0d27 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.212773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-57b5e2c9-cff4-4f3d-a2e3-dd388abf0d27 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.213270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-57b5e2c9-cff4-4f3d-a2e3-dd388abf0d27 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.420592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-57b5e2c9-cff4-4f3d-a2e3-dd388abf0d27 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 14 microversion: 2.1 time: 0.262074 Dec 03 15:03:33.424229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 85/172] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:33 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 14 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:03:33.493596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-966262ce-3f4c-4ee1-a3f3-e2576b3f1aeb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:33.494660 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-966262ce-3f4c-4ee1-a3f3-e2576b3f1aeb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:33.504696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-966262ce-3f4c-4ee1-a3f3-e2576b3f1aeb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.505447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-966262ce-3f4c-4ee1-a3f3-e2576b3f1aeb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.506337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-966262ce-3f4c-4ee1-a3f3-e2576b3f1aeb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.506808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-966262ce-3f4c-4ee1-a3f3-e2576b3f1aeb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.509505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:33.510202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:33.527385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.528411 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.531785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.534625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.610165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] HTTP exception thrown: Instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 could not be found. Dec 03 15:03:33.610992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Returning 404 to user: Instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:03:33.612014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2929c907-464e-470a-8a9c-51bab78023a8 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "DELETE /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 404 len: 111 microversion: 2.1 time: 0.112408 Dec 03 15:03:33.613040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 86/173] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:03:33 2020] DELETE /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:03:33.629821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:33.630540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] [instance: 6df8e3bd-8dd7-4ac4-9409-df9187c8a651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:33.640546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.640546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.641397 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.641901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.693298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-966262ce-3f4c-4ee1-a3f3-e2576b3f1aeb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 14 microversion: 2.20 time: 0.214090 Dec 03 15:03:33.694568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 88/174] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:33 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:33.708904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] HTTP exception thrown: Instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 could not be found. Dec 03 15:03:33.711043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] Returning 404 to user: Instance 6df8e3bd-8dd7-4ac4-9409-df9187c8a651 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:03:33.712811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-482524e4-1373-406d-989e-08a3e8ee2072 tempest-DeleteServersTestJSON-706443464 tempest-DeleteServersTestJSON-706443464] 10.222.0.63 "GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651" status: 404 len: 111 microversion: 2.1 time: 0.095118 Dec 03 15:03:33.713525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 87/175] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:33 2020] GET /compute/v2.1/servers/6df8e3bd-8dd7-4ac4-9409-df9187c8a651 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:03:33.845679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5d358ee7-6063-4a63-a218-a95c53ce240c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:33.847100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5d358ee7-6063-4a63-a218-a95c53ce240c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:33.855709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d358ee7-6063-4a63-a218-a95c53ce240c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.856984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d358ee7-6063-4a63-a218-a95c53ce240c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:33.858543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d358ee7-6063-4a63-a218-a95c53ce240c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:33.859169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d358ee7-6063-4a63-a218-a95c53ce240c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:34.447719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f0a18631-1239-41fd-90d4-3b2dfe54efc2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:34.453301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f0a18631-1239-41fd-90d4-3b2dfe54efc2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:34.470848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5d358ee7-6063-4a63-a218-a95c53ce240c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:34.472976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0a18631-1239-41fd-90d4-3b2dfe54efc2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:34.475462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0a18631-1239-41fd-90d4-3b2dfe54efc2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:34.476540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0a18631-1239-41fd-90d4-3b2dfe54efc2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:34.477254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0a18631-1239-41fd-90d4-3b2dfe54efc2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:34.495481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5d358ee7-6063-4a63-a218-a95c53ce240c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.659762 Dec 03 15:03:34.500298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 89/176] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:33 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:34.711496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4ac53ded-17dd-4a45-946c-b0183019a2db tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:34.715867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4ac53ded-17dd-4a45-946c-b0183019a2db tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:34.717498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f0a18631-1239-41fd-90d4-3b2dfe54efc2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 14 microversion: 2.1 time: 0.286709 Dec 03 15:03:34.718245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 88/177] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:34 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 14 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 03 15:03:34.757672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ac53ded-17dd-4a45-946c-b0183019a2db tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:34.768780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ac53ded-17dd-4a45-946c-b0183019a2db tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:34.770098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ac53ded-17dd-4a45-946c-b0183019a2db tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:34.771201 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ac53ded-17dd-4a45-946c-b0183019a2db tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:35.007491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4ac53ded-17dd-4a45-946c-b0183019a2db tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 14 microversion: 2.20 time: 0.304797 Dec 03 15:03:35.008613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 90/178] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:34 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 14 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:35.518894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7c735537-ea47-4e2b-8d1c-5042f98b4d7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:35.519662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7c735537-ea47-4e2b-8d1c-5042f98b4d7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:35.537394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7c735537-ea47-4e2b-8d1c-5042f98b4d7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:35.537897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7c735537-ea47-4e2b-8d1c-5042f98b4d7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:35.538807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7c735537-ea47-4e2b-8d1c-5042f98b4d7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:35.539301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7c735537-ea47-4e2b-8d1c-5042f98b4d7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:35.759641 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1da24aa5-1d3f-4def-a69b-ea924587b43b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:35.764534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1da24aa5-1d3f-4def-a69b-ea924587b43b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:35.786647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1da24aa5-1d3f-4def-a69b-ea924587b43b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:35.788011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1da24aa5-1d3f-4def-a69b-ea924587b43b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:35.792242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1da24aa5-1d3f-4def-a69b-ea924587b43b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:35.792925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1da24aa5-1d3f-4def-a69b-ea924587b43b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:35.970991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1da24aa5-1d3f-4def-a69b-ea924587b43b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 14 microversion: 2.1 time: 0.244686 Dec 03 15:03:35.975671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 91/179] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:35 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:03:36.025945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ab0ebeb5-c666-4932-a8c9-d7eb1fb5c33f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:36.032829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ab0ebeb5-c666-4932-a8c9-d7eb1fb5c33f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:36.042096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ab0ebeb5-c666-4932-a8c9-d7eb1fb5c33f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:36.042811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ab0ebeb5-c666-4932-a8c9-d7eb1fb5c33f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:36.044047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ab0ebeb5-c666-4932-a8c9-d7eb1fb5c33f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:36.044771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ab0ebeb5-c666-4932-a8c9-d7eb1fb5c33f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:36.298571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ab0ebeb5-c666-4932-a8c9-d7eb1fb5c33f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 14 microversion: 2.20 time: 0.282443 Dec 03 15:03:36.302652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 92/180] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:36 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 14 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:36.304716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7c735537-ea47-4e2b-8d1c-5042f98b4d7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:36.325995 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7c735537-ea47-4e2b-8d1c-5042f98b4d7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.816873 Dec 03 15:03:36.326613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 89/181] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:35 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:36.998621 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e8cd19c1-b724-4aa4-b135-d8fb99c3f50a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:37.002467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e8cd19c1-b724-4aa4-b135-d8fb99c3f50a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:37.014174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8cd19c1-b724-4aa4-b135-d8fb99c3f50a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:37.015193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8cd19c1-b724-4aa4-b135-d8fb99c3f50a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:37.016587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8cd19c1-b724-4aa4-b135-d8fb99c3f50a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:37.017446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8cd19c1-b724-4aa4-b135-d8fb99c3f50a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:37.243601 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e8cd19c1-b724-4aa4-b135-d8fb99c3f50a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 14 microversion: 2.1 time: 0.263825 Dec 03 15:03:37.244159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 93/182] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:36 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 14 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:03:37.319248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e50658bd-5419-4611-84d3-ba84419e4728 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:37.322542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e50658bd-5419-4611-84d3-ba84419e4728 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:37.352624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e50658bd-5419-4611-84d3-ba84419e4728 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:37.354333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e50658bd-5419-4611-84d3-ba84419e4728 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:37.356009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e50658bd-5419-4611-84d3-ba84419e4728 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:37.356878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-58282470-c3d8-48f3-b24b-5c8b4457cfad tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:37.357845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-58282470-c3d8-48f3-b24b-5c8b4457cfad tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:37.360001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e50658bd-5419-4611-84d3-ba84419e4728 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:37.373555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-58282470-c3d8-48f3-b24b-5c8b4457cfad tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:37.374356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-58282470-c3d8-48f3-b24b-5c8b4457cfad tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:37.380540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-58282470-c3d8-48f3-b24b-5c8b4457cfad tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:37.381898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-58282470-c3d8-48f3-b24b-5c8b4457cfad tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:37.534982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e50658bd-5419-4611-84d3-ba84419e4728 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 14 microversion: 2.20 time: 0.227356 Dec 03 15:03:37.538500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 90/183] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:37 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 14 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:38.031929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-58282470-c3d8-48f3-b24b-5c8b4457cfad tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:38.052315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-58282470-c3d8-48f3-b24b-5c8b4457cfad tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.712363 Dec 03 15:03:38.054348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 94/184] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:37 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:38.279641 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5eab4471-4183-452a-aa84-e2f53d91372c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:38.280824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5eab4471-4183-452a-aa84-e2f53d91372c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:38.308046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5eab4471-4183-452a-aa84-e2f53d91372c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:38.308559 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5eab4471-4183-452a-aa84-e2f53d91372c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:38.320215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5eab4471-4183-452a-aa84-e2f53d91372c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:38.320733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5eab4471-4183-452a-aa84-e2f53d91372c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:38.555894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-236fe681-7cbd-44bf-a48c-ab46f0aa0acf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:38.557271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-236fe681-7cbd-44bf-a48c-ab46f0aa0acf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:38.564289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5eab4471-4183-452a-aa84-e2f53d91372c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 6684 microversion: 2.1 time: 0.312042 Dec 03 15:03:38.565541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 91/185] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:38 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 6684 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:38.593800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-236fe681-7cbd-44bf-a48c-ab46f0aa0acf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:38.594751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-236fe681-7cbd-44bf-a48c-ab46f0aa0acf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:38.596096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-236fe681-7cbd-44bf-a48c-ab46f0aa0acf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:38.596770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-236fe681-7cbd-44bf-a48c-ab46f0aa0acf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:38.863639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-236fe681-7cbd-44bf-a48c-ab46f0aa0acf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 10009 microversion: 2.20 time: 0.320267 Dec 03 15:03:38.868036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 95/186] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:38 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 10009 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:03:39.085065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f7f54187-4a09-4760-9494-732e1fd1e417 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:39.085856 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f7f54187-4a09-4760-9494-732e1fd1e417 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:39.096833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7f54187-4a09-4760-9494-732e1fd1e417 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:39.097491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7f54187-4a09-4760-9494-732e1fd1e417 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:39.098383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7f54187-4a09-4760-9494-732e1fd1e417 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:39.098877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7f54187-4a09-4760-9494-732e1fd1e417 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:39.383222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f7f54187-4a09-4760-9494-732e1fd1e417 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:39.398446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f7f54187-4a09-4760-9494-732e1fd1e417 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.332246 Dec 03 15:03:39.402099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 92/187] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:39 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:39.585509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3d5ce39d-876b-4f4b-a1e3-8be8b350f0f1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:39.587378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3d5ce39d-876b-4f4b-a1e3-8be8b350f0f1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:39.597067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d5ce39d-876b-4f4b-a1e3-8be8b350f0f1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:39.597407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d5ce39d-876b-4f4b-a1e3-8be8b350f0f1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:39.598135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d5ce39d-876b-4f4b-a1e3-8be8b350f0f1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:39.598630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d5ce39d-876b-4f4b-a1e3-8be8b350f0f1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:39.768744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3d5ce39d-876b-4f4b-a1e3-8be8b350f0f1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 13861 microversion: 2.1 time: 0.195841 Dec 03 15:03:39.770556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 96/188] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:39 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 13861 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:03:39.885756 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0f95d5f6-4954-43fd-b2ac-9b058c96df2b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:39.887411 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0f95d5f6-4954-43fd-b2ac-9b058c96df2b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:39.898308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0f95d5f6-4954-43fd-b2ac-9b058c96df2b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:39.899305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0f95d5f6-4954-43fd-b2ac-9b058c96df2b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:39.900435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0f95d5f6-4954-43fd-b2ac-9b058c96df2b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:39.900972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0f95d5f6-4954-43fd-b2ac-9b058c96df2b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:40.102239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0f95d5f6-4954-43fd-b2ac-9b058c96df2b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 15064 microversion: 2.20 time: 0.228848 Dec 03 15:03:40.107107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 93/189] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:39 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 15064 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:03:40.425970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e3d11aea-d193-46b3-8f95-8f3c46b15f05 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:40.436613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e3d11aea-d193-46b3-8f95-8f3c46b15f05 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:40.449935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e3d11aea-d193-46b3-8f95-8f3c46b15f05 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:40.451376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e3d11aea-d193-46b3-8f95-8f3c46b15f05 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:40.452630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e3d11aea-d193-46b3-8f95-8f3c46b15f05 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:40.453452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e3d11aea-d193-46b3-8f95-8f3c46b15f05 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:40.791847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cb98bd44-452b-447c-985d-cbedbc8ea48d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:40.794822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cb98bd44-452b-447c-985d-cbedbc8ea48d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:40.820963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb98bd44-452b-447c-985d-cbedbc8ea48d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:40.821741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb98bd44-452b-447c-985d-cbedbc8ea48d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:40.822883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb98bd44-452b-447c-985d-cbedbc8ea48d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:40.823562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb98bd44-452b-447c-985d-cbedbc8ea48d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:40.839858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e3d11aea-d193-46b3-8f95-8f3c46b15f05 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:40.852722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e3d11aea-d193-46b3-8f95-8f3c46b15f05 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.436727 Dec 03 15:03:40.853542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 97/190] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:40 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:41.120346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ccb6edc8-1319-46cd-9ad7-1b36fe6af425 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:41.121480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ccb6edc8-1319-46cd-9ad7-1b36fe6af425 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:41.138759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccb6edc8-1319-46cd-9ad7-1b36fe6af425 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:41.139276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccb6edc8-1319-46cd-9ad7-1b36fe6af425 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:41.140117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccb6edc8-1319-46cd-9ad7-1b36fe6af425 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:41.140773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccb6edc8-1319-46cd-9ad7-1b36fe6af425 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:43.028375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cb98bd44-452b-447c-985d-cbedbc8ea48d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 18449 microversion: 2.1 time: 2.250919 Dec 03 15:03:43.029420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 94/191] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:40 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 18449 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 15:03:43.040394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1d7f5e33-a688-4e4f-a7f1-2774ec878b40 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:43.041174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1d7f5e33-a688-4e4f-a7f1-2774ec878b40 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:43.050514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1d7f5e33-a688-4e4f-a7f1-2774ec878b40 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:43.051237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1d7f5e33-a688-4e4f-a7f1-2774ec878b40 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:43.052096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1d7f5e33-a688-4e4f-a7f1-2774ec878b40 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:43.052595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1d7f5e33-a688-4e4f-a7f1-2774ec878b40 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:43.096000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ccb6edc8-1319-46cd-9ad7-1b36fe6af425 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 19342 microversion: 2.20 time: 1.985102 Dec 03 15:03:43.100942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 98/192] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:41 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 19342 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:03:43.367819 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1d7f5e33-a688-4e4f-a7f1-2774ec878b40 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:43.377106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1d7f5e33-a688-4e4f-a7f1-2774ec878b40 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.346017 Dec 03 15:03:43.377697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 95/193] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:43 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:44.059304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-09e27bd1-0c99-4132-922a-fc450c7de634 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:44.060595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-09e27bd1-0c99-4132-922a-fc450c7de634 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:44.069474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09e27bd1-0c99-4132-922a-fc450c7de634 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:44.070326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09e27bd1-0c99-4132-922a-fc450c7de634 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:44.071348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09e27bd1-0c99-4132-922a-fc450c7de634 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:44.071984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09e27bd1-0c99-4132-922a-fc450c7de634 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:44.119362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4daf5e22-337a-4f87-8a3a-ef47be9f4edc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:44.120745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4daf5e22-337a-4f87-8a3a-ef47be9f4edc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:44.141134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4daf5e22-337a-4f87-8a3a-ef47be9f4edc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:44.150183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4daf5e22-337a-4f87-8a3a-ef47be9f4edc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:44.151163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4daf5e22-337a-4f87-8a3a-ef47be9f4edc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:44.151670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4daf5e22-337a-4f87-8a3a-ef47be9f4edc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:46.239507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-09e27bd1-0c99-4132-922a-fc450c7de634 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 23013 microversion: 2.1 time: 2.201963 Dec 03 15:03:46.241417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 99/194] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:44 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 23013 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:03:46.256827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-084cf30d-abe3-4875-a7b4-d249f714b2f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:46.258324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-084cf30d-abe3-4875-a7b4-d249f714b2f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:46.269442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-084cf30d-abe3-4875-a7b4-d249f714b2f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:46.270088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-084cf30d-abe3-4875-a7b4-d249f714b2f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:46.271903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-084cf30d-abe3-4875-a7b4-d249f714b2f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:46.272824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-084cf30d-abe3-4875-a7b4-d249f714b2f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:46.275261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4daf5e22-337a-4f87-8a3a-ef47be9f4edc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 24254 microversion: 2.20 time: 2.169848 Dec 03 15:03:46.276610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 96/195] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:44 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 24254 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:03:46.613401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-084cf30d-abe3-4875-a7b4-d249f714b2f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:46.627657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-084cf30d-abe3-4875-a7b4-d249f714b2f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.381943 Dec 03 15:03:46.628738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 100/196] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:46 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:47.260184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3c269f84-289d-49d7-a4c9-2b391d6eba8c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:47.261448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3c269f84-289d-49d7-a4c9-2b391d6eba8c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:47.275529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3c269f84-289d-49d7-a4c9-2b391d6eba8c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:47.276534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3c269f84-289d-49d7-a4c9-2b391d6eba8c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:47.278710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3c269f84-289d-49d7-a4c9-2b391d6eba8c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:47.279404 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3c269f84-289d-49d7-a4c9-2b391d6eba8c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:47.295532 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d413a966-b683-4265-8353-5956ff7516f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:47.296548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d413a966-b683-4265-8353-5956ff7516f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:47.306130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d413a966-b683-4265-8353-5956ff7516f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:47.306991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d413a966-b683-4265-8353-5956ff7516f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:47.308030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d413a966-b683-4265-8353-5956ff7516f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:47.309446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d413a966-b683-4265-8353-5956ff7516f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:49.607001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d413a966-b683-4265-8353-5956ff7516f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 26982 microversion: 2.20 time: 2.321041 Dec 03 15:03:49.607753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 101/197] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:47 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 26982 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:03:49.618699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-418e616d-8ac2-46bd-938e-b96649dc8d46 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:49.619483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-418e616d-8ac2-46bd-938e-b96649dc8d46 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:49.630262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3c269f84-289d-49d7-a4c9-2b391d6eba8c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 25724 microversion: 2.1 time: 2.380585 Dec 03 15:03:49.630503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-418e616d-8ac2-46bd-938e-b96649dc8d46 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:49.630909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-418e616d-8ac2-46bd-938e-b96649dc8d46 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:49.631451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 97/198] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:47 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 25724 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:03:49.631801 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-418e616d-8ac2-46bd-938e-b96649dc8d46 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:49.632419 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-418e616d-8ac2-46bd-938e-b96649dc8d46 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:49.879420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-418e616d-8ac2-46bd-938e-b96649dc8d46 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:49.897306 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-418e616d-8ac2-46bd-938e-b96649dc8d46 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.288006 Dec 03 15:03:49.898481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 102/199] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:49 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:50.627395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e1fb08ab-e2d8-44ac-a3c5-33a4447bb84c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:50.629867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e1fb08ab-e2d8-44ac-a3c5-33a4447bb84c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:50.654358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-92eed5eb-2608-4f49-a4f3-5b579b7df156 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:50.655354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1fb08ab-e2d8-44ac-a3c5-33a4447bb84c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:50.656082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1fb08ab-e2d8-44ac-a3c5-33a4447bb84c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:50.657035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1fb08ab-e2d8-44ac-a3c5-33a4447bb84c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:50.658420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-92eed5eb-2608-4f49-a4f3-5b579b7df156 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:50.659024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1fb08ab-e2d8-44ac-a3c5-33a4447bb84c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:50.676748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-92eed5eb-2608-4f49-a4f3-5b579b7df156 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:50.679569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-92eed5eb-2608-4f49-a4f3-5b579b7df156 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:50.682006 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-92eed5eb-2608-4f49-a4f3-5b579b7df156 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:50.687340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-92eed5eb-2608-4f49-a4f3-5b579b7df156 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:52.814398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-92eed5eb-2608-4f49-a4f3-5b579b7df156 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 27711 microversion: 2.1 time: 2.174260 Dec 03 15:03:52.815807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 103/200] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:50 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 27711 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:03:52.826920 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b57a7a61-ee38-4ba7-947e-8ced1fa6d4ba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:52.827700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b57a7a61-ee38-4ba7-947e-8ced1fa6d4ba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:52.836376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b57a7a61-ee38-4ba7-947e-8ced1fa6d4ba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:52.836863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b57a7a61-ee38-4ba7-947e-8ced1fa6d4ba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:52.837718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b57a7a61-ee38-4ba7-947e-8ced1fa6d4ba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:52.838243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b57a7a61-ee38-4ba7-947e-8ced1fa6d4ba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:52.862516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e1fb08ab-e2d8-44ac-a3c5-33a4447bb84c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 27773 microversion: 2.20 time: 2.245847 Dec 03 15:03:52.863204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 98/201] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:50 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 27773 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:03:53.087274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b57a7a61-ee38-4ba7-947e-8ced1fa6d4ba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:53.096057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b57a7a61-ee38-4ba7-947e-8ced1fa6d4ba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.279807 Dec 03 15:03:53.096658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 104/202] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:52 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:53.833330 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-09483284-4991-4455-b739-c9a47efafd42 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:53.834721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-09483284-4991-4455-b739-c9a47efafd42 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:53.843877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09483284-4991-4455-b739-c9a47efafd42 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:53.844384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09483284-4991-4455-b739-c9a47efafd42 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:53.845356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09483284-4991-4455-b739-c9a47efafd42 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:53.845823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09483284-4991-4455-b739-c9a47efafd42 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:53.881501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2e4f04c0-a97e-4822-a836-a1f3c222ad37 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:53.882814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2e4f04c0-a97e-4822-a836-a1f3c222ad37 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:53.891811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e4f04c0-a97e-4822-a836-a1f3c222ad37 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:53.892528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e4f04c0-a97e-4822-a836-a1f3c222ad37 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:53.893539 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e4f04c0-a97e-4822-a836-a1f3c222ad37 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:53.894243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e4f04c0-a97e-4822-a836-a1f3c222ad37 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:56.134071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-09483284-4991-4455-b739-c9a47efafd42 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 27909 microversion: 2.1 time: 2.310942 Dec 03 15:03:56.134782 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 99/203] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:53 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 27909 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:03:56.147153 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-79c47ef4-9075-43b6-a597-c5151ca1eb7b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:56.147921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-79c47ef4-9075-43b6-a597-c5151ca1eb7b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:56.156824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79c47ef4-9075-43b6-a597-c5151ca1eb7b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:56.157336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79c47ef4-9075-43b6-a597-c5151ca1eb7b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:56.158219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79c47ef4-9075-43b6-a597-c5151ca1eb7b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:56.158714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79c47ef4-9075-43b6-a597-c5151ca1eb7b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:56.160610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2e4f04c0-a97e-4822-a836-a1f3c222ad37 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 27948 microversion: 2.20 time: 2.289349 Dec 03 15:03:56.161558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 105/204] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:53 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 27948 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:03:56.402027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-79c47ef4-9075-43b6-a597-c5151ca1eb7b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:56.411620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-79c47ef4-9075-43b6-a597-c5151ca1eb7b tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.274721 Dec 03 15:03:56.412240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 100/205] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:56 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:57.169560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3c5f6d93-5583-4bd4-bb50-47c56d8b2dfb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:57.171560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3c5f6d93-5583-4bd4-bb50-47c56d8b2dfb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:57.180277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5bcc1ffb-16c0-4fd7-9140-439190fdee92 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:57.181359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5bcc1ffb-16c0-4fd7-9140-439190fdee92 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:57.187649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3c5f6d93-5583-4bd4-bb50-47c56d8b2dfb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:57.188339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3c5f6d93-5583-4bd4-bb50-47c56d8b2dfb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:57.189602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3c5f6d93-5583-4bd4-bb50-47c56d8b2dfb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:57.190354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3c5f6d93-5583-4bd4-bb50-47c56d8b2dfb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:57.204496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5bcc1ffb-16c0-4fd7-9140-439190fdee92 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:57.215113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5bcc1ffb-16c0-4fd7-9140-439190fdee92 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:57.219837 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5bcc1ffb-16c0-4fd7-9140-439190fdee92 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:57.220407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5bcc1ffb-16c0-4fd7-9140-439190fdee92 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:57.690163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3c5f6d93-5583-4bd4-bb50-47c56d8b2dfb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 28204 microversion: 2.1 time: 0.532676 Dec 03 15:03:57.690163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 106/206] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:57 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 28204 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:03:57.697654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b158e565-028b-4d76-bb15-35b3a4c5a772 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:57.698671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b158e565-028b-4d76-bb15-35b3a4c5a772 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:57.713588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b158e565-028b-4d76-bb15-35b3a4c5a772 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:57.714399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b158e565-028b-4d76-bb15-35b3a4c5a772 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:57.715420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b158e565-028b-4d76-bb15-35b3a4c5a772 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:57.716194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b158e565-028b-4d76-bb15-35b3a4c5a772 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:57.717251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5bcc1ffb-16c0-4fd7-9140-439190fdee92 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 28183 microversion: 2.20 time: 0.546974 Dec 03 15:03:57.717960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 101/207] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:57 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 28183 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:03:57.992774 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b158e565-028b-4d76-bb15-35b3a4c5a772 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:58.003100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b158e565-028b-4d76-bb15-35b3a4c5a772 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1522 microversion: 2.1 time: 0.315414 Dec 03 15:03:58.003750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 107/208] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:57 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:58.707308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b46e9281-f94c-41af-84bd-7b9eb0ef5b3b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:58.709717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b46e9281-f94c-41af-84bd-7b9eb0ef5b3b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:58.720912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b46e9281-f94c-41af-84bd-7b9eb0ef5b3b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:58.735234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b46e9281-f94c-41af-84bd-7b9eb0ef5b3b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:58.736300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b46e9281-f94c-41af-84bd-7b9eb0ef5b3b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:58.736811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b46e9281-f94c-41af-84bd-7b9eb0ef5b3b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:58.736928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-22f1551c-ba86-4027-a5f0-0fbece4523c1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:58.737928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-22f1551c-ba86-4027-a5f0-0fbece4523c1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:58.748376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-22f1551c-ba86-4027-a5f0-0fbece4523c1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:58.749651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-22f1551c-ba86-4027-a5f0-0fbece4523c1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:58.751229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-22f1551c-ba86-4027-a5f0-0fbece4523c1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:58.751971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-22f1551c-ba86-4027-a5f0-0fbece4523c1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:58.947461 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-22f1551c-ba86-4027-a5f0-0fbece4523c1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 28183 microversion: 2.20 time: 0.221839 Dec 03 15:03:58.948553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 108/209] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:58 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 28183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:03:59.028364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7a8de9d8-6343-4bb9-8247-4f9868143684 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:59.029258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7a8de9d8-6343-4bb9-8247-4f9868143684 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:59.037943 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a8de9d8-6343-4bb9-8247-4f9868143684 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:59.039112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a8de9d8-6343-4bb9-8247-4f9868143684 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:59.040005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a8de9d8-6343-4bb9-8247-4f9868143684 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:59.040471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a8de9d8-6343-4bb9-8247-4f9868143684 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:59.051422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b46e9281-f94c-41af-84bd-7b9eb0ef5b3b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 28204 microversion: 2.1 time: 0.355231 Dec 03 15:03:59.052419 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 102/210] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:03:58 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 28204 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:03:59.278800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7a8de9d8-6343-4bb9-8247-4f9868143684 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:59.288000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7a8de9d8-6343-4bb9-8247-4f9868143684 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1502 microversion: 2.1 time: 0.269313 Dec 03 15:03:59.294377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 109/211] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:59 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:03:59.312356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-664f2b30-8b48-4e53-97ce-6453ab65e90e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:03:59.313354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-664f2b30-8b48-4e53-97ce-6453ab65e90e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:59.322438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-664f2b30-8b48-4e53-97ce-6453ab65e90e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:59.323077 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-664f2b30-8b48-4e53-97ce-6453ab65e90e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:59.324031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-664f2b30-8b48-4e53-97ce-6453ab65e90e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:59.325216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-664f2b30-8b48-4e53-97ce-6453ab65e90e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:59.583412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-664f2b30-8b48-4e53-97ce-6453ab65e90e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:03:59.594811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-664f2b30-8b48-4e53-97ce-6453ab65e90e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1516 microversion: 2.1 time: 0.293486 Dec 03 15:03:59.595778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 103/212] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:03:59 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1516 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:03:59.971972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-22af22fa-e2ae-442c-ad90-62d220c2e19c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:03:59.973012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-22af22fa-e2ae-442c-ad90-62d220c2e19c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:03:59.992337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-22af22fa-e2ae-442c-ad90-62d220c2e19c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:59.992853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-22af22fa-e2ae-442c-ad90-62d220c2e19c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:03:59.993713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-22af22fa-e2ae-442c-ad90-62d220c2e19c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:03:59.999898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-22af22fa-e2ae-442c-ad90-62d220c2e19c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:00.075838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ce998106-3a7f-4cae-a57b-81e8f099b5fa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:00.077890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ce998106-3a7f-4cae-a57b-81e8f099b5fa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:00.096815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce998106-3a7f-4cae-a57b-81e8f099b5fa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:00.097558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce998106-3a7f-4cae-a57b-81e8f099b5fa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:00.099197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce998106-3a7f-4cae-a57b-81e8f099b5fa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:00.104408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce998106-3a7f-4cae-a57b-81e8f099b5fa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:00.206552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-22af22fa-e2ae-442c-ad90-62d220c2e19c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 28474 microversion: 2.20 time: 0.249754 Dec 03 15:04:00.207983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 110/213] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:03:59 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 28474 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:00.370587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ce998106-3a7f-4cae-a57b-81e8f099b5fa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 28495 microversion: 2.1 time: 0.308537 Dec 03 15:04:00.376798 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 104/214] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:00 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 28495 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:01.226849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0465b26b-0a14-46f7-bea4-3285193ab66b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:01.228086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0465b26b-0a14-46f7-bea4-3285193ab66b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:01.238186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0465b26b-0a14-46f7-bea4-3285193ab66b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:01.238785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0465b26b-0a14-46f7-bea4-3285193ab66b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:01.239866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0465b26b-0a14-46f7-bea4-3285193ab66b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:01.240447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0465b26b-0a14-46f7-bea4-3285193ab66b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:01.390394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f34271f1-4697-493d-9b84-28b08521c8ad tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:01.391759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f34271f1-4697-493d-9b84-28b08521c8ad tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:01.401830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f34271f1-4697-493d-9b84-28b08521c8ad tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:01.403375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f34271f1-4697-493d-9b84-28b08521c8ad tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:01.404481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f34271f1-4697-493d-9b84-28b08521c8ad tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:01.405163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f34271f1-4697-493d-9b84-28b08521c8ad tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:04.170482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0465b26b-0a14-46f7-bea4-3285193ab66b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 28641 microversion: 2.20 time: 2.953752 Dec 03 15:04:04.171672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 111/215] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:01 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 28641 bytes in 2957 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:04.186541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bdb7b85e-23cb-465c-96fe-57d396ed2209 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:04.187712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bdb7b85e-23cb-465c-96fe-57d396ed2209 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:04.195816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bdb7b85e-23cb-465c-96fe-57d396ed2209 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:04.196322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bdb7b85e-23cb-465c-96fe-57d396ed2209 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:04.197160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bdb7b85e-23cb-465c-96fe-57d396ed2209 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:04.197645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bdb7b85e-23cb-465c-96fe-57d396ed2209 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:04.254543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f34271f1-4697-493d-9b84-28b08521c8ad tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 28662 microversion: 2.1 time: 2.874006 Dec 03 15:04:04.255235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 105/216] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:01 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 28662 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:04.265770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-bdb7b85e-23cb-465c-96fe-57d396ed2209 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lazy-loading 'flavor' on Instance uuid c233978f-9c32-47bf-8b66-44f0baa08830 {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:04:04.425359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bdb7b85e-23cb-465c-96fe-57d396ed2209 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/action" status: 200 len: 32 microversion: 2.1 time: 0.251963 Dec 03 15:04:04.426110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 112/217] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:04 2020] POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:04:04.442127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bc08356a-638d-41bc-bac4-8cf18587f1b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:04.442923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bc08356a-638d-41bc-bac4-8cf18587f1b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:04.451774 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bc08356a-638d-41bc-bac4-8cf18587f1b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:04.452289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bc08356a-638d-41bc-bac4-8cf18587f1b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:04.453149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bc08356a-638d-41bc-bac4-8cf18587f1b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:04.453644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bc08356a-638d-41bc-bac4-8cf18587f1b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:04.691784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bc08356a-638d-41bc-bac4-8cf18587f1b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:04.702725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bc08356a-638d-41bc-bac4-8cf18587f1b1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.270254 Dec 03 15:04:04.704076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 106/218] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:04 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:05.191625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ea4b9fd4-5898-47af-8999-229502b6fb0e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:05.193380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ea4b9fd4-5898-47af-8999-229502b6fb0e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:05.206747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea4b9fd4-5898-47af-8999-229502b6fb0e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:05.207507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea4b9fd4-5898-47af-8999-229502b6fb0e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:05.209171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea4b9fd4-5898-47af-8999-229502b6fb0e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:05.209838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ea4b9fd4-5898-47af-8999-229502b6fb0e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:05.275212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ad7bb736-6f9f-4413-abe0-7093e56ecfb4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:05.276154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ad7bb736-6f9f-4413-abe0-7093e56ecfb4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:05.297652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ad7bb736-6f9f-4413-abe0-7093e56ecfb4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:05.298197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ad7bb736-6f9f-4413-abe0-7093e56ecfb4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:05.299173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ad7bb736-6f9f-4413-abe0-7093e56ecfb4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:05.299666 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ad7bb736-6f9f-4413-abe0-7093e56ecfb4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:05.391172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ea4b9fd4-5898-47af-8999-229502b6fb0e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 28641 microversion: 2.20 time: 0.211281 Dec 03 15:04:05.392684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 113/219] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:05 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 28641 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:05.484140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ad7bb736-6f9f-4413-abe0-7093e56ecfb4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 28662 microversion: 2.1 time: 0.220105 Dec 03 15:04:05.484923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 107/220] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:05 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 28662 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:05.734923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e87be413-5859-49ae-8f56-8b7860d5a8f7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:05.737802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e87be413-5859-49ae-8f56-8b7860d5a8f7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:05.747332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e87be413-5859-49ae-8f56-8b7860d5a8f7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:05.748283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e87be413-5859-49ae-8f56-8b7860d5a8f7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:05.749346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e87be413-5859-49ae-8f56-8b7860d5a8f7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:05.750052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e87be413-5859-49ae-8f56-8b7860d5a8f7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:06.122738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e87be413-5859-49ae-8f56-8b7860d5a8f7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:06.134865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e87be413-5859-49ae-8f56-8b7860d5a8f7 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.416419 Dec 03 15:04:06.135484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 114/221] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:05 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:06.412864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8fe31526-8221-477d-8ccd-44e8fd456de7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:06.414064 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8fe31526-8221-477d-8ccd-44e8fd456de7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:06.430049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8fe31526-8221-477d-8ccd-44e8fd456de7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:06.430049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8fe31526-8221-477d-8ccd-44e8fd456de7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:06.430049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8fe31526-8221-477d-8ccd-44e8fd456de7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:06.430049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8fe31526-8221-477d-8ccd-44e8fd456de7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:06.508485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b7829877-6b97-4777-9a76-6920f60562e5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:06.514971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b7829877-6b97-4777-9a76-6920f60562e5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:06.527968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7829877-6b97-4777-9a76-6920f60562e5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:06.528470 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7829877-6b97-4777-9a76-6920f60562e5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:06.529517 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7829877-6b97-4777-9a76-6920f60562e5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:06.530088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7829877-6b97-4777-9a76-6920f60562e5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:06.569555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8fe31526-8221-477d-8ccd-44e8fd456de7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 28641 microversion: 2.20 time: 0.168531 Dec 03 15:04:06.571291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 108/222] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:06 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 28641 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:04:06.681287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b7829877-6b97-4777-9a76-6920f60562e5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 28662 microversion: 2.1 time: 0.187794 Dec 03 15:04:06.682140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 115/223] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:06 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 28662 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:07.162436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d018672a-f587-4e05-bda1-278762ef17dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:07.163615 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d018672a-f587-4e05-bda1-278762ef17dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:07.174368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d018672a-f587-4e05-bda1-278762ef17dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:07.175076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d018672a-f587-4e05-bda1-278762ef17dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:07.186291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d018672a-f587-4e05-bda1-278762ef17dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:07.186291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d018672a-f587-4e05-bda1-278762ef17dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:07.591742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-53afdab3-8a4a-4452-bfb7-55fa2615092f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:07.595890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-53afdab3-8a4a-4452-bfb7-55fa2615092f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:07.619914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53afdab3-8a4a-4452-bfb7-55fa2615092f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:07.620837 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53afdab3-8a4a-4452-bfb7-55fa2615092f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:07.633476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53afdab3-8a4a-4452-bfb7-55fa2615092f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:07.633476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53afdab3-8a4a-4452-bfb7-55fa2615092f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:07.794380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-53afdab3-8a4a-4452-bfb7-55fa2615092f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 28641 microversion: 2.20 time: 0.214683 Dec 03 15:04:07.795749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 116/224] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:07 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 28641 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:07.838544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-303a94ce-04df-478b-bfe9-832c849adf3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:07.840878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-303a94ce-04df-478b-bfe9-832c849adf3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:07.854139 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-303a94ce-04df-478b-bfe9-832c849adf3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:07.854988 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-303a94ce-04df-478b-bfe9-832c849adf3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:07.856902 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-303a94ce-04df-478b-bfe9-832c849adf3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:07.857805 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-303a94ce-04df-478b-bfe9-832c849adf3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:07.901703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d018672a-f587-4e05-bda1-278762ef17dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:07.926742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d018672a-f587-4e05-bda1-278762ef17dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.776472 Dec 03 15:04:07.927815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 109/225] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:07 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:08.059340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-303a94ce-04df-478b-bfe9-832c849adf3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 28662 microversion: 2.1 time: 0.258189 Dec 03 15:04:08.061158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 117/226] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:07 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 28662 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:08.815073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d8ebdd53-316d-4f97-bf49-762befb3de12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:08.816049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d8ebdd53-316d-4f97-bf49-762befb3de12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:08.825197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d8ebdd53-316d-4f97-bf49-762befb3de12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:08.826426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d8ebdd53-316d-4f97-bf49-762befb3de12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:08.828054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d8ebdd53-316d-4f97-bf49-762befb3de12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:08.828862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d8ebdd53-316d-4f97-bf49-762befb3de12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:08.952508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-af1f26bb-4b53-4367-bde6-b5a46012e315 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:08.954751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-af1f26bb-4b53-4367-bde6-b5a46012e315 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:08.962678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af1f26bb-4b53-4367-bde6-b5a46012e315 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:08.963173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af1f26bb-4b53-4367-bde6-b5a46012e315 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:08.964033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af1f26bb-4b53-4367-bde6-b5a46012e315 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:08.964531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af1f26bb-4b53-4367-bde6-b5a46012e315 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:08.981624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d8ebdd53-316d-4f97-bf49-762befb3de12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 28641 microversion: 2.20 time: 0.175760 Dec 03 15:04:08.982900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 110/227] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:08 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 28641 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:09.081998 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1281a0ad-c062-4140-bc7a-d133a461a2d9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:09.083533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1281a0ad-c062-4140-bc7a-d133a461a2d9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:09.094976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1281a0ad-c062-4140-bc7a-d133a461a2d9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:09.096204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1281a0ad-c062-4140-bc7a-d133a461a2d9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:09.097302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1281a0ad-c062-4140-bc7a-d133a461a2d9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:09.098027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1281a0ad-c062-4140-bc7a-d133a461a2d9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:09.260897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1281a0ad-c062-4140-bc7a-d133a461a2d9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 28694 microversion: 2.1 time: 0.192268 Dec 03 15:04:09.262384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 111/228] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:09 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 28694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 15:04:09.299125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-af1f26bb-4b53-4367-bde6-b5a46012e315 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:09.323459 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-af1f26bb-4b53-4367-bde6-b5a46012e315 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.368547 Dec 03 15:04:09.323459 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 118/229] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:08 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:09.999002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-55a28d11-c917-480c-94df-090680595f91 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:10.000216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-55a28d11-c917-480c-94df-090680595f91 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:10.023075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55a28d11-c917-480c-94df-090680595f91 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:10.023908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55a28d11-c917-480c-94df-090680595f91 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:10.025100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55a28d11-c917-480c-94df-090680595f91 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:10.025766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55a28d11-c917-480c-94df-090680595f91 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:10.191112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-55a28d11-c917-480c-94df-090680595f91 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 29317 microversion: 2.20 time: 0.201513 Dec 03 15:04:10.191890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 112/230] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:09 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 29317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:10.280393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-35b1bfda-91a8-4eb2-a36f-b6b301fa0beb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:10.281625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-35b1bfda-91a8-4eb2-a36f-b6b301fa0beb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:10.290281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-35b1bfda-91a8-4eb2-a36f-b6b301fa0beb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:10.291068 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-35b1bfda-91a8-4eb2-a36f-b6b301fa0beb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:10.291978 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-35b1bfda-91a8-4eb2-a36f-b6b301fa0beb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:10.292749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-35b1bfda-91a8-4eb2-a36f-b6b301fa0beb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:10.356889 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4cb56f5f-876b-4513-bd50-159847f3cdf3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:10.358567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4cb56f5f-876b-4513-bd50-159847f3cdf3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:10.378374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4cb56f5f-876b-4513-bd50-159847f3cdf3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:10.379077 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4cb56f5f-876b-4513-bd50-159847f3cdf3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:10.380041 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4cb56f5f-876b-4513-bd50-159847f3cdf3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:10.380623 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4cb56f5f-876b-4513-bd50-159847f3cdf3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:10.454357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-35b1bfda-91a8-4eb2-a36f-b6b301fa0beb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 30079 microversion: 2.1 time: 0.183742 Dec 03 15:04:10.458446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 119/231] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:10 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 30079 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:10.768845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4cb56f5f-876b-4513-bd50-159847f3cdf3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:10.802532 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4cb56f5f-876b-4513-bd50-159847f3cdf3 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.474253 Dec 03 15:04:10.841555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 113/232] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:10 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:11.219524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-04d039fa-ffca-4ded-b689-314f90d95c0b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:11.233820 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-04d039fa-ffca-4ded-b689-314f90d95c0b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:11.257967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-04d039fa-ffca-4ded-b689-314f90d95c0b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:11.258704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-04d039fa-ffca-4ded-b689-314f90d95c0b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:11.259869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-04d039fa-ffca-4ded-b689-314f90d95c0b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:11.264243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-04d039fa-ffca-4ded-b689-314f90d95c0b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:11.473263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eb36741a-9d5c-4c0d-a81e-552fee1b9f25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:11.483131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-eb36741a-9d5c-4c0d-a81e-552fee1b9f25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:11.502256 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb36741a-9d5c-4c0d-a81e-552fee1b9f25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:11.502779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb36741a-9d5c-4c0d-a81e-552fee1b9f25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:11.509313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb36741a-9d5c-4c0d-a81e-552fee1b9f25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:11.510529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb36741a-9d5c-4c0d-a81e-552fee1b9f25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:11.539818 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-04d039fa-ffca-4ded-b689-314f90d95c0b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 30821 microversion: 2.20 time: 0.338612 Dec 03 15:04:11.540905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 120/233] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:11 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 30821 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:11.735672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eb36741a-9d5c-4c0d-a81e-552fee1b9f25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 31535 microversion: 2.1 time: 0.271776 Dec 03 15:04:11.739881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 114/234] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:11 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 31535 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:11.831209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-de95c5b3-7933-4a8a-8186-daeb959d5e07 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:11.831996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-de95c5b3-7933-4a8a-8186-daeb959d5e07 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:11.864963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-de95c5b3-7933-4a8a-8186-daeb959d5e07 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:11.865412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-de95c5b3-7933-4a8a-8186-daeb959d5e07 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:11.866337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-de95c5b3-7933-4a8a-8186-daeb959d5e07 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:11.878026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-de95c5b3-7933-4a8a-8186-daeb959d5e07 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:12.575314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-958c2d0b-49e3-4698-a524-6538ec748582 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:12.577936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-958c2d0b-49e3-4698-a524-6538ec748582 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:12.607082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-958c2d0b-49e3-4698-a524-6538ec748582 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:12.607948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-958c2d0b-49e3-4698-a524-6538ec748582 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:12.609514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-958c2d0b-49e3-4698-a524-6538ec748582 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:12.610023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-958c2d0b-49e3-4698-a524-6538ec748582 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:12.763765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-de95c5b3-7933-4a8a-8186-daeb959d5e07 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:12.789234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-de95c5b3-7933-4a8a-8186-daeb959d5e07 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.968082 Dec 03 15:04:12.789841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 121/235] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:11 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:12.806142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-958c2d0b-49e3-4698-a524-6538ec748582 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 32246 microversion: 2.20 time: 0.256520 Dec 03 15:04:12.806827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 115/236] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:12 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 32246 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:04:12.826254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-43a24b47-77a6-4e53-a2bc-7dabef3f7dc7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:12.835266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-43a24b47-77a6-4e53-a2bc-7dabef3f7dc7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:12.868301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-43a24b47-77a6-4e53-a2bc-7dabef3f7dc7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:12.868915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-43a24b47-77a6-4e53-a2bc-7dabef3f7dc7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:12.869976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-43a24b47-77a6-4e53-a2bc-7dabef3f7dc7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:12.872861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-43a24b47-77a6-4e53-a2bc-7dabef3f7dc7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:13.095187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-43a24b47-77a6-4e53-a2bc-7dabef3f7dc7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 32961 microversion: 2.1 time: 0.294030 Dec 03 15:04:13.096037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 122/237] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:12 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 32961 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:13.817935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8bdea568-b672-48f0-b604-f83ddb9537ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:13.825528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2a4313bd-9e5f-4151-ae32-12deb4602281 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:13.831124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8bdea568-b672-48f0-b604-f83ddb9537ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:13.835488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2a4313bd-9e5f-4151-ae32-12deb4602281 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:13.840530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8bdea568-b672-48f0-b604-f83ddb9537ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:13.841266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8bdea568-b672-48f0-b604-f83ddb9537ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:13.853472 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a4313bd-9e5f-4151-ae32-12deb4602281 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:13.854248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a4313bd-9e5f-4151-ae32-12deb4602281 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:13.855640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8bdea568-b672-48f0-b604-f83ddb9537ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:13.855983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a4313bd-9e5f-4151-ae32-12deb4602281 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:13.856168 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8bdea568-b672-48f0-b604-f83ddb9537ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:13.856782 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a4313bd-9e5f-4151-ae32-12deb4602281 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:14.015282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2a4313bd-9e5f-4151-ae32-12deb4602281 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 33344 microversion: 2.20 time: 0.199388 Dec 03 15:04:14.018638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 123/238] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:13 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 33344 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:14.116050 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-80f2aaf9-8c16-410b-8615-82977cee4767 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:14.117620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-80f2aaf9-8c16-410b-8615-82977cee4767 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:14.137518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80f2aaf9-8c16-410b-8615-82977cee4767 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:14.138260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80f2aaf9-8c16-410b-8615-82977cee4767 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:14.139292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80f2aaf9-8c16-410b-8615-82977cee4767 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:14.139935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80f2aaf9-8c16-410b-8615-82977cee4767 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:14.332105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-80f2aaf9-8c16-410b-8615-82977cee4767 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 33635 microversion: 2.1 time: 0.227566 Dec 03 15:04:14.332809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 124/239] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:14 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 33635 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:14.670861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8bdea568-b672-48f0-b604-f83ddb9537ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:14.697730 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8bdea568-b672-48f0-b604-f83ddb9537ca tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.893369 Dec 03 15:04:14.700254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 116/240] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:13 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:15.040533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-800ab5a3-e8fc-4eaf-ae39-718ce4a504ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:15.043772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-800ab5a3-e8fc-4eaf-ae39-718ce4a504ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:15.057307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-800ab5a3-e8fc-4eaf-ae39-718ce4a504ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:15.058912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-800ab5a3-e8fc-4eaf-ae39-718ce4a504ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:15.060012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-800ab5a3-e8fc-4eaf-ae39-718ce4a504ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:15.060709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-800ab5a3-e8fc-4eaf-ae39-718ce4a504ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:15.303929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-800ab5a3-e8fc-4eaf-ae39-718ce4a504ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 34073 microversion: 2.20 time: 0.276351 Dec 03 15:04:15.309748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 125/241] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:15 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 34073 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:15.356119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-82c80e61-59cc-423a-95f5-97af7a3e1cfc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:15.357301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-82c80e61-59cc-423a-95f5-97af7a3e1cfc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:15.378200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82c80e61-59cc-423a-95f5-97af7a3e1cfc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:15.378710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82c80e61-59cc-423a-95f5-97af7a3e1cfc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:15.379577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82c80e61-59cc-423a-95f5-97af7a3e1cfc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:15.380040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82c80e61-59cc-423a-95f5-97af7a3e1cfc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:15.662135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-82c80e61-59cc-423a-95f5-97af7a3e1cfc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 35597 microversion: 2.1 time: 0.320948 Dec 03 15:04:15.663194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 117/242] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:15 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 35597 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:15.730211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d0b31889-05b2-436e-b22f-1899903672a8 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:15.737726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d0b31889-05b2-436e-b22f-1899903672a8 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:15.776042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0b31889-05b2-436e-b22f-1899903672a8 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:15.777604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0b31889-05b2-436e-b22f-1899903672a8 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:15.778521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0b31889-05b2-436e-b22f-1899903672a8 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:15.779026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0b31889-05b2-436e-b22f-1899903672a8 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:16.324776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-86c30869-77cb-4a87-ace2-d18df9be2603 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:16.333808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-86c30869-77cb-4a87-ace2-d18df9be2603 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:16.363544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86c30869-77cb-4a87-ace2-d18df9be2603 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:16.364059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86c30869-77cb-4a87-ace2-d18df9be2603 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:16.364934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86c30869-77cb-4a87-ace2-d18df9be2603 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:16.365428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86c30869-77cb-4a87-ace2-d18df9be2603 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:16.537588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d0b31889-05b2-436e-b22f-1899903672a8 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:16.561565 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d0b31889-05b2-436e-b22f-1899903672a8 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.846188 Dec 03 15:04:16.563799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 126/243] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:15 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:16.662182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-86c30869-77cb-4a87-ace2-d18df9be2603 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 35057 microversion: 2.20 time: 0.348976 Dec 03 15:04:16.662871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 118/244] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:16 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 35057 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:16.682822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0db72464-acde-40f8-a729-9bc3f25b688e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:16.683437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0db72464-acde-40f8-a729-9bc3f25b688e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:16.705645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0db72464-acde-40f8-a729-9bc3f25b688e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:16.706609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0db72464-acde-40f8-a729-9bc3f25b688e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:16.718855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0db72464-acde-40f8-a729-9bc3f25b688e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:16.719725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0db72464-acde-40f8-a729-9bc3f25b688e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:17.419984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0db72464-acde-40f8-a729-9bc3f25b688e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 36820 microversion: 2.1 time: 0.745718 Dec 03 15:04:17.421421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 127/245] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:16 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 36820 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:17.603907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a1e166ef-6e97-422d-b1fd-8836dde33552 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:17.609745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a1e166ef-6e97-422d-b1fd-8836dde33552 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:17.646975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1e166ef-6e97-422d-b1fd-8836dde33552 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:17.649848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1e166ef-6e97-422d-b1fd-8836dde33552 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:17.650875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1e166ef-6e97-422d-b1fd-8836dde33552 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:17.654534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1e166ef-6e97-422d-b1fd-8836dde33552 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:17.683013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-71074ae8-18e4-46a3-8194-6679860622e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:17.696040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-71074ae8-18e4-46a3-8194-6679860622e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:17.710197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-71074ae8-18e4-46a3-8194-6679860622e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:17.716452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-71074ae8-18e4-46a3-8194-6679860622e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:17.718283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-71074ae8-18e4-46a3-8194-6679860622e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:17.719118 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-71074ae8-18e4-46a3-8194-6679860622e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:18.179607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-71074ae8-18e4-46a3-8194-6679860622e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 36296 microversion: 2.20 time: 0.506713 Dec 03 15:04:18.181143 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 128/246] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:17 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 36296 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:18.267492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a1e166ef-6e97-422d-b1fd-8836dde33552 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:18.282217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a1e166ef-6e97-422d-b1fd-8836dde33552 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.704753 Dec 03 15:04:18.287093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 119/247] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:17 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:18.444047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-03f02782-7ec5-4223-8d78-966a6f4f9526 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:18.446872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-03f02782-7ec5-4223-8d78-966a6f4f9526 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:18.467396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03f02782-7ec5-4223-8d78-966a6f4f9526 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:18.470707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03f02782-7ec5-4223-8d78-966a6f4f9526 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:18.472213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03f02782-7ec5-4223-8d78-966a6f4f9526 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:18.474289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03f02782-7ec5-4223-8d78-966a6f4f9526 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:18.760495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-03f02782-7ec5-4223-8d78-966a6f4f9526 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 37990 microversion: 2.1 time: 0.329866 Dec 03 15:04:18.767578 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 129/248] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:18 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 37990 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:19.198904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ca95ba20-d5f5-40c7-99d0-4f66bb30cde3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:19.205488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ca95ba20-d5f5-40c7-99d0-4f66bb30cde3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:19.238867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca95ba20-d5f5-40c7-99d0-4f66bb30cde3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:19.239374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca95ba20-d5f5-40c7-99d0-4f66bb30cde3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:19.240230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca95ba20-d5f5-40c7-99d0-4f66bb30cde3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:19.240692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca95ba20-d5f5-40c7-99d0-4f66bb30cde3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:19.320670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-059a60fe-456d-4bcc-a8d3-9548cbe06a11 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:19.326612 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-059a60fe-456d-4bcc-a8d3-9548cbe06a11 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:19.360433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-059a60fe-456d-4bcc-a8d3-9548cbe06a11 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:19.361866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-059a60fe-456d-4bcc-a8d3-9548cbe06a11 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:19.362770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-059a60fe-456d-4bcc-a8d3-9548cbe06a11 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:19.363265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-059a60fe-456d-4bcc-a8d3-9548cbe06a11 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:19.597187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ca95ba20-d5f5-40c7-99d0-4f66bb30cde3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 37645 microversion: 2.20 time: 0.408955 Dec 03 15:04:19.597867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 120/249] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:19 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 37645 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:04:19.784149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5a59566d-df66-4a89-812e-af5fff1a2c1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:19.787904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5a59566d-df66-4a89-812e-af5fff1a2c1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:19.810666 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5a59566d-df66-4a89-812e-af5fff1a2c1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:19.811175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5a59566d-df66-4a89-812e-af5fff1a2c1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:19.813328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5a59566d-df66-4a89-812e-af5fff1a2c1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:19.813829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5a59566d-df66-4a89-812e-af5fff1a2c1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:20.049854 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5a59566d-df66-4a89-812e-af5fff1a2c1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 38187 microversion: 2.1 time: 0.280031 Dec 03 15:04:20.050791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 121/250] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:19 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 38187 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:20.460002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-059a60fe-456d-4bcc-a8d3-9548cbe06a11 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:20.474933 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-059a60fe-456d-4bcc-a8d3-9548cbe06a11 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1502 microversion: 2.1 time: 1.178542 Dec 03 15:04:20.497327 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 130/251] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:19 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1502 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:20.502810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "776aee56-4b58-4809-bdcf-0223b8d98773"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:20.508657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:20.529160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:20.531701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:20.542980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:20.543734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:20.614874 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-af06798a-9d00-498a-845f-c7cd0069f82f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:20.618549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-af06798a-9d00-498a-845f-c7cd0069f82f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:20.640512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af06798a-9d00-498a-845f-c7cd0069f82f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:20.641140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af06798a-9d00-498a-845f-c7cd0069f82f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:20.643688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af06798a-9d00-498a-845f-c7cd0069f82f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:20.644358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af06798a-9d00-498a-845f-c7cd0069f82f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:20.713993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] HTTP exception thrown: Cannot 'attach_volume' instance c233978f-9c32-47bf-8b66-44f0baa08830 while it is in vm_state rescued Dec 03 15:04:20.716950 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Returning 409 to user: Cannot 'attach_volume' instance c233978f-9c32-47bf-8b66-44f0baa08830 while it is in vm_state rescued {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:04:20.719914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a651b900-6ca5-44be-8f3d-bb3ac4d7f069 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.230680 Dec 03 15:04:20.721988 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 122/252] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:04:20 2020] POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/os-volume_attachments => generated 152 bytes in 233 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 03 15:04:20.742680 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f3aaf4b9-3cc2-4f10-8672-4658649cf98a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:20.762814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f3aaf4b9-3cc2-4f10-8672-4658649cf98a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:20.797629 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3aaf4b9-3cc2-4f10-8672-4658649cf98a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:20.798169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3aaf4b9-3cc2-4f10-8672-4658649cf98a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:20.799025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3aaf4b9-3cc2-4f10-8672-4658649cf98a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:20.799554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3aaf4b9-3cc2-4f10-8672-4658649cf98a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:20.887105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-af06798a-9d00-498a-845f-c7cd0069f82f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 38175 microversion: 2.20 time: 0.281878 Dec 03 15:04:20.888071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 131/253] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:20 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 38175 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:04:21.029074 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f3aaf4b9-3cc2-4f10-8672-4658649cf98a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/action" status: 202 len: 0 microversion: 2.1 time: 0.301236 Dec 03 15:04:21.030527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 123/254] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:20 2020] POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:21.047128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-222a39a1-89cd-4e60-9683-4818e4a0ab4e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:21.048414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-222a39a1-89cd-4e60-9683-4818e4a0ab4e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:21.064915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-222a39a1-89cd-4e60-9683-4818e4a0ab4e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:21.068267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-222a39a1-89cd-4e60-9683-4818e4a0ab4e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:21.069340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-222a39a1-89cd-4e60-9683-4818e4a0ab4e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:21.070018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-222a39a1-89cd-4e60-9683-4818e4a0ab4e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:21.078900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b01e5413-1c14-4194-948f-532f29a7b7ca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:21.081142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b01e5413-1c14-4194-948f-532f29a7b7ca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:21.102922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b01e5413-1c14-4194-948f-532f29a7b7ca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:21.103602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b01e5413-1c14-4194-948f-532f29a7b7ca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:21.107100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b01e5413-1c14-4194-948f-532f29a7b7ca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:21.110872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b01e5413-1c14-4194-948f-532f29a7b7ca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:21.343131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b01e5413-1c14-4194-948f-532f29a7b7ca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 38187 microversion: 2.1 time: 0.283345 Dec 03 15:04:21.345120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 124/255] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:21 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 38187 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:21.911881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7aab1311-af4e-411e-9eaf-7f1206806d21 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:21.913667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7aab1311-af4e-411e-9eaf-7f1206806d21 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:21.923925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7aab1311-af4e-411e-9eaf-7f1206806d21 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:21.924707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7aab1311-af4e-411e-9eaf-7f1206806d21 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:21.924851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-222a39a1-89cd-4e60-9683-4818e4a0ab4e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:21.925859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7aab1311-af4e-411e-9eaf-7f1206806d21 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:21.926531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7aab1311-af4e-411e-9eaf-7f1206806d21 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:21.946392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-222a39a1-89cd-4e60-9683-4818e4a0ab4e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1510 microversion: 2.1 time: 0.911099 Dec 03 15:04:21.957189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 132/256] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:21 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1510 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:22.115264 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7aab1311-af4e-411e-9eaf-7f1206806d21 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 38175 microversion: 2.20 time: 0.218382 Dec 03 15:04:22.120285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 125/257] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:21 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 38175 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:04:22.375265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-baccbde6-cdc6-456d-99f3-a3c82d4d0cca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:22.375903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-baccbde6-cdc6-456d-99f3-a3c82d4d0cca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:22.396438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-baccbde6-cdc6-456d-99f3-a3c82d4d0cca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:22.396959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-baccbde6-cdc6-456d-99f3-a3c82d4d0cca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:22.397838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-baccbde6-cdc6-456d-99f3-a3c82d4d0cca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:22.402525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-baccbde6-cdc6-456d-99f3-a3c82d4d0cca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:22.567887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-baccbde6-cdc6-456d-99f3-a3c82d4d0cca tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 38187 microversion: 2.1 time: 0.210117 Dec 03 15:04:22.578810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 133/258] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:22 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 38187 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:22.973613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0d740e36-b2a3-4148-8998-3fb94de8bff2 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:22.975270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0d740e36-b2a3-4148-8998-3fb94de8bff2 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:22.996678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d740e36-b2a3-4148-8998-3fb94de8bff2 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:22.997428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d740e36-b2a3-4148-8998-3fb94de8bff2 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:22.998500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d740e36-b2a3-4148-8998-3fb94de8bff2 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:22.999191 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d740e36-b2a3-4148-8998-3fb94de8bff2 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:23.152567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2bc19518-c015-41b6-88ad-bc7c599b2989 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:23.153789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2bc19518-c015-41b6-88ad-bc7c599b2989 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:23.184717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2bc19518-c015-41b6-88ad-bc7c599b2989 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:23.185248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2bc19518-c015-41b6-88ad-bc7c599b2989 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:23.186364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2bc19518-c015-41b6-88ad-bc7c599b2989 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:23.187029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2bc19518-c015-41b6-88ad-bc7c599b2989 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:23.359377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2bc19518-c015-41b6-88ad-bc7c599b2989 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 200 len: 38318 microversion: 2.20 time: 0.234515 Dec 03 15:04:23.361288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 134/259] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:23 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 38318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:23.387494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0ab6e313-e303-4f6f-855e-806c6d07c4c5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:23.388543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0ab6e313-e303-4f6f-855e-806c6d07c4c5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:23.411777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0ab6e313-e303-4f6f-855e-806c6d07c4c5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:23.413419 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0ab6e313-e303-4f6f-855e-806c6d07c4c5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:23.418405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0ab6e313-e303-4f6f-855e-806c6d07c4c5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:23.419261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0ab6e313-e303-4f6f-855e-806c6d07c4c5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:23.514077 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0ab6e313-e303-4f6f-855e-806c6d07c4c5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/ips" status: 200 len: 151 microversion: 2.20 time: 0.146348 Dec 03 15:04:23.515149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 135/260] 10.222.0.63 () {60 vars in 1279 bytes} [Thu Dec 3 15:04:23 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/ips => generated 151 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:23.588739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0d740e36-b2a3-4148-8998-3fb94de8bff2 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:23.593821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-752f4587-7a72-4f19-831a-f7c07ba5ea25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:23.603019 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-752f4587-7a72-4f19-831a-f7c07ba5ea25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:23.624548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0d740e36-b2a3-4148-8998-3fb94de8bff2 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1510 microversion: 2.1 time: 0.658199 Dec 03 15:04:23.626716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 126/261] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:22 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1510 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:23.633183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-752f4587-7a72-4f19-831a-f7c07ba5ea25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:23.633698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-752f4587-7a72-4f19-831a-f7c07ba5ea25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:23.634596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-752f4587-7a72-4f19-831a-f7c07ba5ea25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:23.635095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-752f4587-7a72-4f19-831a-f7c07ba5ea25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:23.860409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-752f4587-7a72-4f19-831a-f7c07ba5ea25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 200 len: 38318 microversion: 2.1 time: 0.277705 Dec 03 15:04:23.862741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 136/262] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:23 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 38318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:04:23.881971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-15e28202-e11c-4b05-83f1-ec1cb10d0fc9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:23.882507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-15e28202-e11c-4b05-83f1-ec1cb10d0fc9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:23.915688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15e28202-e11c-4b05-83f1-ec1cb10d0fc9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:23.920604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15e28202-e11c-4b05-83f1-ec1cb10d0fc9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:23.922714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15e28202-e11c-4b05-83f1-ec1cb10d0fc9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:23.925384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15e28202-e11c-4b05-83f1-ec1cb10d0fc9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:24.182553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-15e28202-e11c-4b05-83f1-ec1cb10d0fc9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/ips" status: 200 len: 147 microversion: 2.1 time: 0.313153 Dec 03 15:04:24.185674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 127/263] 10.222.0.63 () {58 vars in 1238 bytes} [Thu Dec 3 15:04:23 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/ips => generated 147 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:04:24.652197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f42a5c8b-b144-46db-9613-c468b266ab14 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:24.663551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f42a5c8b-b144-46db-9613-c468b266ab14 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:24.678546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f42a5c8b-b144-46db-9613-c468b266ab14 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:24.680608 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f42a5c8b-b144-46db-9613-c468b266ab14 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:24.681675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f42a5c8b-b144-46db-9613-c468b266ab14 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:24.683676 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f42a5c8b-b144-46db-9613-c468b266ab14 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:25.159481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f42a5c8b-b144-46db-9613-c468b266ab14 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:25.170044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f42a5c8b-b144-46db-9613-c468b266ab14 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1510 microversion: 2.1 time: 0.527921 Dec 03 15:04:25.170674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 137/264] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:24 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1510 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:26.197348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6e7b40a7-c488-4e87-bacf-1be067131c51 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:26.202997 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6e7b40a7-c488-4e87-bacf-1be067131c51 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:26.236372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e7b40a7-c488-4e87-bacf-1be067131c51 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:26.241027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e7b40a7-c488-4e87-bacf-1be067131c51 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:26.243187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e7b40a7-c488-4e87-bacf-1be067131c51 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:26.247231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e7b40a7-c488-4e87-bacf-1be067131c51 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:26.951900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6e7b40a7-c488-4e87-bacf-1be067131c51 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:26.972448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6e7b40a7-c488-4e87-bacf-1be067131c51 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1516 microversion: 2.1 time: 0.785172 Dec 03 15:04:26.973670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 128/265] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:26 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1516 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:27.132411 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bd3898e2-a234-463e-a5cf-5d4a7f0c3d12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:27.137241 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bd3898e2-a234-463e-a5cf-5d4a7f0c3d12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:27.157900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bd3898e2-a234-463e-a5cf-5d4a7f0c3d12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:27.161104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bd3898e2-a234-463e-a5cf-5d4a7f0c3d12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:27.167644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bd3898e2-a234-463e-a5cf-5d4a7f0c3d12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:27.168318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bd3898e2-a234-463e-a5cf-5d4a7f0c3d12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:27.352418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-bd3898e2-a234-463e-a5cf-5d4a7f0c3d12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lazy-loading 'flavor' on Instance uuid f53f7d53-2ae6-4edd-84c2-09e523498d7d {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:04:28.207054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8f1475c2-0d44-4a9f-9de3-1b8adfe41fe4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87626393-f38f-4fcc-9bec-911d1f19ec0c"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:28.208804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8f1475c2-0d44-4a9f-9de3-1b8adfe41fe4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:28.231960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f1475c2-0d44-4a9f-9de3-1b8adfe41fe4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:28.232867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f1475c2-0d44-4a9f-9de3-1b8adfe41fe4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:28.236831 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f1475c2-0d44-4a9f-9de3-1b8adfe41fe4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:28.237544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f1475c2-0d44-4a9f-9de3-1b8adfe41fe4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:28.379879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bd3898e2-a234-463e-a5cf-5d4a7f0c3d12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 202 len: 0 microversion: 2.20 time: 1.256016 Dec 03 15:04:28.387411 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 138/266] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:04:27 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 0 bytes in 1271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:04:28.440210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:28.445444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:28.492469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:28.495434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:28.498991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:28.502060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:29.300692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:29.326872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:29.336031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:29.337244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-115a8bd4-1816-4bc7-acdd-e187622a13d1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.948073 Dec 03 15:04:29.338569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 139/267] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:28 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:30.065096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b20708df-d8bd-493c-91dd-d3eba8e2b4aa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:30.067131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b20708df-d8bd-493c-91dd-d3eba8e2b4aa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:30.077785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b20708df-d8bd-493c-91dd-d3eba8e2b4aa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:30.078493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b20708df-d8bd-493c-91dd-d3eba8e2b4aa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:30.078649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8f1475c2-0d44-4a9f-9de3-1b8adfe41fe4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.884201 Dec 03 15:04:30.079302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 129/268] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:04:28 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/os-volume_attachments => generated 194 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:04:30.080023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b20708df-d8bd-493c-91dd-d3eba8e2b4aa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:30.080674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b20708df-d8bd-493c-91dd-d3eba8e2b4aa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:30.373209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:30.373881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:30.404481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:30.413550 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:30.418450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:30.422152 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:30.599437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b20708df-d8bd-493c-91dd-d3eba8e2b4aa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:30.610173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b20708df-d8bd-493c-91dd-d3eba8e2b4aa tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1516 microversion: 2.1 time: 0.560919 Dec 03 15:04:30.611001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 140/269] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:30 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1516 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:04:30.653008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5699f752-77b1-4922-93ea-b17c3a036ecc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3ee42ee-3766-4b26-b392-a45bf1153784"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:30.659704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5699f752-77b1-4922-93ea-b17c3a036ecc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:30.678932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5699f752-77b1-4922-93ea-b17c3a036ecc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:30.682234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5699f752-77b1-4922-93ea-b17c3a036ecc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:30.683424 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5699f752-77b1-4922-93ea-b17c3a036ecc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:30.684114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5699f752-77b1-4922-93ea-b17c3a036ecc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:31.008106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:31.056671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:31.066289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:31.068263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3e7747bb-1752-4b2b-8595-e8d8fecdd852 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.713444 Dec 03 15:04:31.077404 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 130/270] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:30 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:04:32.097092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:32.097752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:32.115722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:32.116406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:32.117387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:32.118052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:32.435296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:32.453588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:32.461282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:32.463088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8560a779-6606-4265-a32c-dde0537a8dc0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.377884 Dec 03 15:04:32.465026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 131/271] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:32 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:33.007866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5699f752-77b1-4922-93ea-b17c3a036ecc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.378623 Dec 03 15:04:33.008764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 141/272] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:04:30 2020] POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/os-volume_attachments => generated 194 bytes in 2385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:04:33.491976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:33.494015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:33.503879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:33.504554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:33.505549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:33.506239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:33.763728 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:33.797727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:33.806457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:33.808467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7e31cb2e-4b36-461a-8b7a-c6f1b7468735 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.328663 Dec 03 15:04:33.809217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 132/273] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:33 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:34.835293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:34.836244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:34.845800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:34.846475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:34.847456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:34.848070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:35.108164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:35.125390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:35.133554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:35.135210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-992e1efe-4b04-4d11-9982-14032c870f56 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.310157 Dec 03 15:04:35.149650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 142/274] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:34 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:36.164536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:36.165398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:36.174408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:36.175067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:36.177758 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:36.178428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:36.445796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:36.465343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:36.473062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:36.474727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9521370f-93a3-4674-9f3f-cb3961a19542 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.321429 Dec 03 15:04:36.475646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 133/275] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:36 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:37.505425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:37.506269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:37.516101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:37.516779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:37.518098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:37.518831 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:37.812018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:37.831724 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:37.838884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:37.840798 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-46a0ae2f-f3a1-4aeb-95bc-c0e3bbc412ad tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.347441 Dec 03 15:04:37.841480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 143/276] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:37 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:38.367469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7715816e-35ee-4009-98d3-3f9d6d9c7359 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'create', calling method: .version_select at 0x7fd5f61b3ea0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1451647261"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:38.396042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-7715816e-35ee-4009-98d3-3f9d6d9c7359 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Getting quotas for project 26c9d45e8fe5417f944a2053d351ef69. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:04:38.400148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-7715816e-35ee-4009-98d3-3f9d6d9c7359 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Getting quotas for user f26a891786834ee18291b68690c6b68f and project 26c9d45e8fe5417f944a2053d351ef69. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:04:38.627292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-7715816e-35ee-4009-98d3-3f9d6d9c7359 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Getting quotas for project 26c9d45e8fe5417f944a2053d351ef69. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:04:38.631372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-7715816e-35ee-4009-98d3-3f9d6d9c7359 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Getting quotas for user f26a891786834ee18291b68690c6b68f and project 26c9d45e8fe5417f944a2053d351ef69. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:04:38.645637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7715816e-35ee-4009-98d3-3f9d6d9c7359 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.287120 Dec 03 15:04:38.646510 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 134/277] 10.222.0.63 () {60 vars in 1148 bytes} [Thu Dec 3 15:04:38 2020] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:38.828991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1280870906", "imageRef": "5c7f99d8-fdf9-4097-9f33-1f75e806ab94", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1451647261", "networks": [{"uuid": "52cd6ebc-32b4-40f6-9b98-6760dd6218f7"}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:38.866418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:38.867224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:38.876454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:38.877062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:38.878035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:38.878635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:38.905463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] validate_networks() for [('52cd6ebc-32b4-40f6-9b98-6760dd6218f7', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:04:39.111299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:39.127569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:39.134475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:39.136504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cdcff295-b9f4-487e-91e3-6e6e11acfedf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.278972 Dec 03 15:04:39.148245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 135/278] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:38 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:39.506763 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:04:39.507189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:04:39.507728 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:04:39.508187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:04:39.508750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:04:39.518405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:39.518910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:39.519780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:39.520267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:39.538788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Getting quotas for project 26c9d45e8fe5417f944a2053d351ef69. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:04:39.543277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Getting quotas for user f26a891786834ee18291b68690c6b68f and project 26c9d45e8fe5417f944a2053d351ef69. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:04:39.554872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:04:39.557401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5c7f99d8-fdf9-4097-9f33-1f75e806ab94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:04:39.608584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a73d0b4b-b535-466a-b533-b7836924a4ed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789545 Dec 03 15:04:39.609488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 144/279] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:04:38 2020] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:04:39.625729 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e04bfc0b-40ce-4156-a090-d3aef4f63211 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:39.637861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e04bfc0b-40ce-4156-a090-d3aef4f63211 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:39.843338 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e04bfc0b-40ce-4156-a090-d3aef4f63211 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:39.862188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e04bfc0b-40ce-4156-a090-d3aef4f63211 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1259 microversion: 2.1 time: 0.246253 Dec 03 15:04:39.868667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 136/280] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:39 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:40.134232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e67659f6-ece5-4c55-9a72-4021c61a8a05 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:40.148132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e67659f6-ece5-4c55-9a72-4021c61a8a05 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:40.149078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e67659f6-ece5-4c55-9a72-4021c61a8a05 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:40.170322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:40.171158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:40.189983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:40.196663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:40.197743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:40.199257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:40.272917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e67659f6-ece5-4c55-9a72-4021c61a8a05 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Going to try to stop instance {{(pid=94373) force_stop /opt/stack/nova/nova/compute/api.py:2576}} Dec 03 15:04:40.370303 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e67659f6-ece5-4c55-9a72-4021c61a8a05 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 202 len: 0 microversion: 2.1 time: 0.247513 Dec 03 15:04:40.371554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 145/281] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:40 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:04:40.395381 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2b186c66-32cd-4c59-9b62-4d94788631b6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:40.396344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2b186c66-32cd-4c59-9b62-4d94788631b6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:40.405122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b186c66-32cd-4c59-9b62-4d94788631b6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:40.406007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b186c66-32cd-4c59-9b62-4d94788631b6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:40.407028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b186c66-32cd-4c59-9b62-4d94788631b6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:40.407942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b186c66-32cd-4c59-9b62-4d94788631b6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:40.475830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:40.491212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:40.500887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:40.500887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-986ed39d-621f-4867-b97b-ee823fadca26 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.347884 Dec 03 15:04:40.512502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 137/282] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:40 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:40.701636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2b186c66-32cd-4c59-9b62-4d94788631b6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:40.712007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2b186c66-32cd-4c59-9b62-4d94788631b6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.329797 Dec 03 15:04:40.712609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 146/283] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:40 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:40.892487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ced97dd5-f42f-458f-adaf-aba0ee4937fa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:40.893080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ced97dd5-f42f-458f-adaf-aba0ee4937fa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:40.900963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced97dd5-f42f-458f-adaf-aba0ee4937fa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:40.901842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced97dd5-f42f-458f-adaf-aba0ee4937fa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:40.902482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced97dd5-f42f-458f-adaf-aba0ee4937fa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:40.902979 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced97dd5-f42f-458f-adaf-aba0ee4937fa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:41.050617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ced97dd5-f42f-458f-adaf-aba0ee4937fa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:41.063023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ced97dd5-f42f-458f-adaf-aba0ee4937fa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1311 microversion: 2.1 time: 0.180274 Dec 03 15:04:41.064587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 138/284] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:40 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:41.536852 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:41.539162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:41.567958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:41.568566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:41.569676 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:41.570227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:41.749509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c0686c94-7c9b-4d84-9a83-a579c5dd329f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:41.751779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c0686c94-7c9b-4d84-9a83-a579c5dd329f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:41.780049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0686c94-7c9b-4d84-9a83-a579c5dd329f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:41.780564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0686c94-7c9b-4d84-9a83-a579c5dd329f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:41.789628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0686c94-7c9b-4d84-9a83-a579c5dd329f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:41.790699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0686c94-7c9b-4d84-9a83-a579c5dd329f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:42.123843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:42.140300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:42.147917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:42.149165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-63fcf406-9529-4ee7-bfa0-06cae80b1320 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.633153 Dec 03 15:04:42.150908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 147/285] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:41 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:42.164573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5ca706e2-67dd-4ca1-bbe4-23e87b90acf6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:42.165472 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5ca706e2-67dd-4ca1-bbe4-23e87b90acf6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:42.175884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5ca706e2-67dd-4ca1-bbe4-23e87b90acf6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:42.176770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5ca706e2-67dd-4ca1-bbe4-23e87b90acf6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:42.177838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5ca706e2-67dd-4ca1-bbe4-23e87b90acf6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:42.178473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5ca706e2-67dd-4ca1-bbe4-23e87b90acf6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:42.344119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5ca706e2-67dd-4ca1-bbe4-23e87b90acf6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:42.358932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5ca706e2-67dd-4ca1-bbe4-23e87b90acf6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1317 microversion: 2.1 time: 0.205760 Dec 03 15:04:42.359876 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 148/286] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:42 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:42.366596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c0686c94-7c9b-4d84-9a83-a579c5dd329f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:42.395094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c0686c94-7c9b-4d84-9a83-a579c5dd329f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.664234 Dec 03 15:04:42.395773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 139/287] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:41 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:43.188416 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:43.189090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:43.247189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:43.254471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:43.265523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:43.266126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:43.391216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d4c6af30-6f77-45f5-9b69-5ae429ec9317 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:43.393179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d4c6af30-6f77-45f5-9b69-5ae429ec9317 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:43.413743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d4c6af30-6f77-45f5-9b69-5ae429ec9317 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:43.438803 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d4c6af30-6f77-45f5-9b69-5ae429ec9317 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:43.440347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d4c6af30-6f77-45f5-9b69-5ae429ec9317 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:43.441137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d4c6af30-6f77-45f5-9b69-5ae429ec9317 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:44.200054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:44.279183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:44.307375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:44.318864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-47c46d22-0c7e-4e74-8a4d-0faf92b07599 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 1.144466 Dec 03 15:04:44.333947 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 149/288] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:43 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:44.374217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-34d420d9-adad-4816-a613-5b68c7ad75c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:44.378714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-34d420d9-adad-4816-a613-5b68c7ad75c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:44.392887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34d420d9-adad-4816-a613-5b68c7ad75c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:44.408903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d4c6af30-6f77-45f5-9b69-5ae429ec9317 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:44.409190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34d420d9-adad-4816-a613-5b68c7ad75c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:44.410414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34d420d9-adad-4816-a613-5b68c7ad75c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:44.413637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34d420d9-adad-4816-a613-5b68c7ad75c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:44.426478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d4c6af30-6f77-45f5-9b69-5ae429ec9317 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 1.050044 Dec 03 15:04:44.427137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 140/289] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:43 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:45.212941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-34d420d9-adad-4816-a613-5b68c7ad75c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:45.228967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-34d420d9-adad-4816-a613-5b68c7ad75c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.883217 Dec 03 15:04:45.229741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 150/290] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:44 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:45.367553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:45.368359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:45.377932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:45.378614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:45.380100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:45.380679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:45.470962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-13b07d60-9820-4790-8216-d5526842a4a2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:45.474034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-13b07d60-9820-4790-8216-d5526842a4a2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:45.500185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13b07d60-9820-4790-8216-d5526842a4a2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:45.500827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13b07d60-9820-4790-8216-d5526842a4a2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:45.501715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13b07d60-9820-4790-8216-d5526842a4a2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:45.502415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13b07d60-9820-4790-8216-d5526842a4a2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:46.005120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:46.052029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:46.082112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:46.100100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f88f2342-7804-48ab-8671-93a57dcb3b3d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.746290 Dec 03 15:04:46.101089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 141/291] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:45 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:46.169977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-13b07d60-9820-4790-8216-d5526842a4a2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:46.198669 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-13b07d60-9820-4790-8216-d5526842a4a2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.755377 Dec 03 15:04:46.201240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 151/292] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:45 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:46.268948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4dba13dd-e23b-4d13-9f6e-010364a6cc0d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:46.270201 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4dba13dd-e23b-4d13-9f6e-010364a6cc0d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:46.299007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4dba13dd-e23b-4d13-9f6e-010364a6cc0d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:46.299948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4dba13dd-e23b-4d13-9f6e-010364a6cc0d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:46.301224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4dba13dd-e23b-4d13-9f6e-010364a6cc0d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:46.302223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4dba13dd-e23b-4d13-9f6e-010364a6cc0d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:46.797005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4dba13dd-e23b-4d13-9f6e-010364a6cc0d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:46.847716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4dba13dd-e23b-4d13-9f6e-010364a6cc0d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.592762 Dec 03 15:04:46.864158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 142/293] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:46 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:47.126409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:47.127064 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:47.147851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:47.148359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:47.149215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:47.149709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:47.232385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ca6b2426-16f2-4ea7-b38d-941f31a17228 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:47.239022 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ca6b2426-16f2-4ea7-b38d-941f31a17228 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:47.257499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca6b2426-16f2-4ea7-b38d-941f31a17228 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:47.258362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca6b2426-16f2-4ea7-b38d-941f31a17228 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:47.259430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca6b2426-16f2-4ea7-b38d-941f31a17228 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:47.267012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ca6b2426-16f2-4ea7-b38d-941f31a17228 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:47.682183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ca6b2426-16f2-4ea7-b38d-941f31a17228 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:47.708690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ca6b2426-16f2-4ea7-b38d-941f31a17228 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.489120 Dec 03 15:04:47.710896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 143/294] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:47 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:47.900372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6578505c-4c98-43df-ba86-a7e0dfeedfdb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:47.903292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6578505c-4c98-43df-ba86-a7e0dfeedfdb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:47.931790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6578505c-4c98-43df-ba86-a7e0dfeedfdb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:47.933151 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6578505c-4c98-43df-ba86-a7e0dfeedfdb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:47.936676 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6578505c-4c98-43df-ba86-a7e0dfeedfdb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:47.937617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6578505c-4c98-43df-ba86-a7e0dfeedfdb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:47.968203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:48.000811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:48.015500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:48.019465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cad3f4f7-8617-4fef-8a24-df93bf897677 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.902978 Dec 03 15:04:48.021164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 152/295] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:47 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:48.596604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6578505c-4c98-43df-ba86-a7e0dfeedfdb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:48.607448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6578505c-4c98-43df-ba86-a7e0dfeedfdb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.727126 Dec 03 15:04:48.629618 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 144/296] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:47 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:48.737373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f1e86da1-8f59-4d69-ba44-10cc0420a336 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:48.741297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f1e86da1-8f59-4d69-ba44-10cc0420a336 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:48.780772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1e86da1-8f59-4d69-ba44-10cc0420a336 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:48.790079 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1e86da1-8f59-4d69-ba44-10cc0420a336 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:48.791054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1e86da1-8f59-4d69-ba44-10cc0420a336 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:48.791757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1e86da1-8f59-4d69-ba44-10cc0420a336 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:49.048448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:49.049583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:49.058206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:49.058877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:49.060392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:49.060888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:49.100895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f1e86da1-8f59-4d69-ba44-10cc0420a336 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:49.126302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f1e86da1-8f59-4d69-ba44-10cc0420a336 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.399220 Dec 03 15:04:49.127290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 153/297] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:48 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:49.438988 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:49.507805 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:49.516973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:49.527376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3db3625d-1941-425e-8660-44e588e5d465 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.481553 Dec 03 15:04:49.528401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 145/298] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:49 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:49.631433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6682a8c5-4058-4358-83ff-232a77168031 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:49.632116 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6682a8c5-4058-4358-83ff-232a77168031 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:49.653075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6682a8c5-4058-4358-83ff-232a77168031 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:49.653075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6682a8c5-4058-4358-83ff-232a77168031 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:49.653923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6682a8c5-4058-4358-83ff-232a77168031 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:49.654439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6682a8c5-4058-4358-83ff-232a77168031 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:50.152947 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-69731d0e-e4e0-492b-ae33-7d84a8731d30 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:50.153601 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-69731d0e-e4e0-492b-ae33-7d84a8731d30 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:50.163840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-69731d0e-e4e0-492b-ae33-7d84a8731d30 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:50.164576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-69731d0e-e4e0-492b-ae33-7d84a8731d30 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:50.165536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-69731d0e-e4e0-492b-ae33-7d84a8731d30 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:50.166277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-69731d0e-e4e0-492b-ae33-7d84a8731d30 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:50.290677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6682a8c5-4058-4358-83ff-232a77168031 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:50.306307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6682a8c5-4058-4358-83ff-232a77168031 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.683900 Dec 03 15:04:50.307021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 154/299] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:49 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:50.463463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-69731d0e-e4e0-492b-ae33-7d84a8731d30 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:50.511247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-69731d0e-e4e0-492b-ae33-7d84a8731d30 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.368038 Dec 03 15:04:50.512239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 146/300] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:50 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:50.559692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:50.560722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:50.570363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:50.572172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:50.574351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:50.575059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:51.032423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-23445478", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "7563c63a-7ae2-448f-9a35-0b81ebf9961f"}]}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:51.124246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:51.168625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:51.175664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:51.177128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ae667b39-a846-4f1e-a3d1-c03c2dc209b6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.632682 Dec 03 15:04:51.177939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 155/301] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:50 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:51.337167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1fba0eeb-32fd-4fe1-956f-548e3977e140 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:51.338456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1fba0eeb-32fd-4fe1-956f-548e3977e140 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:51.351622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1fba0eeb-32fd-4fe1-956f-548e3977e140 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:51.352188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1fba0eeb-32fd-4fe1-956f-548e3977e140 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:51.353059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1fba0eeb-32fd-4fe1-956f-548e3977e140 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:51.353557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1fba0eeb-32fd-4fe1-956f-548e3977e140 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:52.553211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1fba0eeb-32fd-4fe1-956f-548e3977e140 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:52.594357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1fba0eeb-32fd-4fe1-956f-548e3977e140 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 1.273198 Dec 03 15:04:52.596111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 156/302] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:51 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:04:52.632081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-20800204-6b46-4911-8830-3ecaf624c36f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:52.633181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-20800204-6b46-4911-8830-3ecaf624c36f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:52.644016 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-20800204-6b46-4911-8830-3ecaf624c36f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:52.645510 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-20800204-6b46-4911-8830-3ecaf624c36f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:52.646644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-20800204-6b46-4911-8830-3ecaf624c36f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:52.647334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-20800204-6b46-4911-8830-3ecaf624c36f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:52.818514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] validate_networks() for [('7563c63a-7ae2-448f-9a35-0b81ebf9961f', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:04:53.740438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-20800204-6b46-4911-8830-3ecaf624c36f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:53.769615 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-20800204-6b46-4911-8830-3ecaf624c36f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 1.170205 Dec 03 15:04:53.770602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 157/303] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:52 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:53.799371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:53.802679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:53.819973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:53.824679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:53.825723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:53.827303 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:53.937682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:04:53.938193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:04:53.938739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:04:53.939205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:04:53.939671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:04:53.954734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:53.957519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:53.960225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:53.961021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:54.020353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Getting quotas for project ce1ba93ac65044e99ad68789f769dd71. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:04:54.025081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Getting quotas for user 042d0d7452254183ba3531b7c01a830b and project ce1ba93ac65044e99ad68789f769dd71. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:04:54.047368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:04:54.050624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:04:54.191575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0d36384e-6d0b-4544-aa52-652b74a3bb9c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.170867 Dec 03 15:04:54.193646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 147/304] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:04:51 2020] POST /compute/v2.1/servers => generated 380 bytes in 3174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:04:54.222358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e739b5f0-bfee-4008-b84a-d13096e7de89 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:54.225667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e739b5f0-bfee-4008-b84a-d13096e7de89 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:54.246417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e739b5f0-bfee-4008-b84a-d13096e7de89 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:54.247185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e739b5f0-bfee-4008-b84a-d13096e7de89 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:54.248249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e739b5f0-bfee-4008-b84a-d13096e7de89 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:54.248952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e739b5f0-bfee-4008-b84a-d13096e7de89 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:54.733967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e739b5f0-bfee-4008-b84a-d13096e7de89 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:54.785899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e739b5f0-bfee-4008-b84a-d13096e7de89 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.586595 Dec 03 15:04:54.787657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 148/305] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:54 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:54.808229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b54e3048-2fc3-4285-a0ba-7bfa820a6f8c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:54.808918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b54e3048-2fc3-4285-a0ba-7bfa820a6f8c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:55.002307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b54e3048-2fc3-4285-a0ba-7bfa820a6f8c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:55.026628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b54e3048-2fc3-4285-a0ba-7bfa820a6f8c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1212 microversion: 2.1 time: 0.237428 Dec 03 15:04:55.030848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 149/306] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:54 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1212 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:55.054895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c575f825-9033-41b0-a36f-6a956b666abe tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:55.054895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c575f825-9033-41b0-a36f-6a956b666abe tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:55.097866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c575f825-9033-41b0-a36f-6a956b666abe tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:55.110719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c575f825-9033-41b0-a36f-6a956b666abe tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:55.111916 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c575f825-9033-41b0-a36f-6a956b666abe tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:55.113621 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c575f825-9033-41b0-a36f-6a956b666abe tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:55.342649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:55.358933 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:55.366773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:55.378349 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3e28b00c-2a6a-4b9c-b353-b747135ae616 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 1.595781 Dec 03 15:04:55.380458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 158/307] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:53 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:55.569338 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c575f825-9033-41b0-a36f-6a956b666abe tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:55.587488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c575f825-9033-41b0-a36f-6a956b666abe tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.555167 Dec 03 15:04:55.588307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 150/308] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:55 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:55.816694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b7b3ba68-410b-40cc-ae6f-b01417b0281a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:55.817373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b7b3ba68-410b-40cc-ae6f-b01417b0281a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:55.836410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7b3ba68-410b-40cc-ae6f-b01417b0281a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:55.841595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7b3ba68-410b-40cc-ae6f-b01417b0281a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:55.850996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7b3ba68-410b-40cc-ae6f-b01417b0281a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:55.852042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7b3ba68-410b-40cc-ae6f-b01417b0281a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:56.055904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1818c583-7d3b-44af-a1a4-359f81cd3163 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:56.057312 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1818c583-7d3b-44af-a1a4-359f81cd3163 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:56.067109 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1818c583-7d3b-44af-a1a4-359f81cd3163 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:56.067621 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1818c583-7d3b-44af-a1a4-359f81cd3163 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:56.068501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1818c583-7d3b-44af-a1a4-359f81cd3163 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:56.069002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1818c583-7d3b-44af-a1a4-359f81cd3163 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:56.218153 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1818c583-7d3b-44af-a1a4-359f81cd3163 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:56.228035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1818c583-7d3b-44af-a1a4-359f81cd3163 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1216 microversion: 2.1 time: 0.182538 Dec 03 15:04:56.229199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 151/309] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:56 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:04:56.421601 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:56.422793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:56.433457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:56.434316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:56.435194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:56.435695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:56.664137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b7b3ba68-410b-40cc-ae6f-b01417b0281a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:56.675384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b7b3ba68-410b-40cc-ae6f-b01417b0281a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.874371 Dec 03 15:04:56.676369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 159/310] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:55 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:56.699576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a876aaf0-b0fb-4b89-bae4-bf298b733789 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:56.700626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a876aaf0-b0fb-4b89-bae4-bf298b733789 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:56.706341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:56.709237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a876aaf0-b0fb-4b89-bae4-bf298b733789 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:56.710278 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a876aaf0-b0fb-4b89-bae4-bf298b733789 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:56.711434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a876aaf0-b0fb-4b89-bae4-bf298b733789 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:56.712495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a876aaf0-b0fb-4b89-bae4-bf298b733789 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:56.726773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:56.738164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:56.739911 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b9c5b28c-1f26-45d9-aced-a5edcd860cd3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.341928 Dec 03 15:04:56.740514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 152/311] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:56 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:04:57.254176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9c6e00fd-ae62-477a-a07f-3f8e43a6fecf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:57.270202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9c6e00fd-ae62-477a-a07f-3f8e43a6fecf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:57.270202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c6e00fd-ae62-477a-a07f-3f8e43a6fecf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:57.271790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c6e00fd-ae62-477a-a07f-3f8e43a6fecf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:57.272870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c6e00fd-ae62-477a-a07f-3f8e43a6fecf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:57.273554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c6e00fd-ae62-477a-a07f-3f8e43a6fecf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:57.484588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a876aaf0-b0fb-4b89-bae4-bf298b733789 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:57.506229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a876aaf0-b0fb-4b89-bae4-bf298b733789 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.816584 Dec 03 15:04:57.516919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 160/312] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:56 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:57.540325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9c6e00fd-ae62-477a-a07f-3f8e43a6fecf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:57.552503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9c6e00fd-ae62-477a-a07f-3f8e43a6fecf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1264 microversion: 2.1 time: 0.309920 Dec 03 15:04:57.554225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 153/313] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:57 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1264 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:04:57.706123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-dbca0756-c673-4648-bfc9-6fdf723ef3e3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:57.717996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-dbca0756-c673-4648-bfc9-6fdf723ef3e3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:57.727421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dbca0756-c673-4648-bfc9-6fdf723ef3e3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:57.727935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dbca0756-c673-4648-bfc9-6fdf723ef3e3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:57.728767 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dbca0756-c673-4648-bfc9-6fdf723ef3e3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:57.730032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dbca0756-c673-4648-bfc9-6fdf723ef3e3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:57.774081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:57.774771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:57.805778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:57.806250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:57.807606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:57.807606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:58.483366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:58.509986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:58.520974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:58.523057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9c40754a-f3a4-4493-8da3-d93b89a2ea6f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1743 microversion: 2.20 time: 0.766387 Dec 03 15:04:58.524118 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 154/314] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:04:57 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1743 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:04:58.536614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1083090f-cc03-4f10-8915-9bf7f2ddfd7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:04:58.538958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1083090f-cc03-4f10-8915-9bf7f2ddfd7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:58.551148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1083090f-cc03-4f10-8915-9bf7f2ddfd7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:58.551850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1083090f-cc03-4f10-8915-9bf7f2ddfd7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:58.552987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1083090f-cc03-4f10-8915-9bf7f2ddfd7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:58.553674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1083090f-cc03-4f10-8915-9bf7f2ddfd7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:58.630036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-1083090f-cc03-4f10-8915-9bf7f2ddfd7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lazy-loading 'flavor' on Instance uuid c233978f-9c32-47bf-8b66-44f0baa08830 {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:04:58.974779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1083090f-cc03-4f10-8915-9bf7f2ddfd7e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/action" status: 200 len: 32 microversion: 2.1 time: 0.448533 Dec 03 15:04:58.979755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 155/315] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:04:58 2020] POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/action => generated 32 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:04:58.988933 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-39ab31a4-796f-4966-9e5b-49b7d906e73d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:58.990242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-39ab31a4-796f-4966-9e5b-49b7d906e73d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:59.001368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-39ab31a4-796f-4966-9e5b-49b7d906e73d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:59.002053 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-39ab31a4-796f-4966-9e5b-49b7d906e73d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:59.003158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-39ab31a4-796f-4966-9e5b-49b7d906e73d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:59.003741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-39ab31a4-796f-4966-9e5b-49b7d906e73d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:59.468344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dbca0756-c673-4648-bfc9-6fdf723ef3e3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:59.478526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-dbca0756-c673-4648-bfc9-6fdf723ef3e3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 1.786460 Dec 03 15:04:59.480009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 161/316] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:57 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:59.490483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c575dbd4-8fa8-421e-8987-4f788945f2e6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:59.491777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c575dbd4-8fa8-421e-8987-4f788945f2e6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:59.501228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c575dbd4-8fa8-421e-8987-4f788945f2e6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:59.502127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c575dbd4-8fa8-421e-8987-4f788945f2e6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:59.503220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c575dbd4-8fa8-421e-8987-4f788945f2e6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:59.503907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c575dbd4-8fa8-421e-8987-4f788945f2e6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:59.660420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-39ab31a4-796f-4966-9e5b-49b7d906e73d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:04:59.673161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-39ab31a4-796f-4966-9e5b-49b7d906e73d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.696701 Dec 03 15:04:59.683460 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 156/317] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:58 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:04:59.686302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-32311f48-3f8f-4377-94b7-5f4208cd4e91 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:04:59.687045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-32311f48-3f8f-4377-94b7-5f4208cd4e91 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:04:59.698246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-32311f48-3f8f-4377-94b7-5f4208cd4e91 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:59.698772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-32311f48-3f8f-4377-94b7-5f4208cd4e91 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:04:59.699633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-32311f48-3f8f-4377-94b7-5f4208cd4e91 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:04:59.700133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-32311f48-3f8f-4377-94b7-5f4208cd4e91 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:00.398411 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-32311f48-3f8f-4377-94b7-5f4208cd4e91 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:00.412089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-32311f48-3f8f-4377-94b7-5f4208cd4e91 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1568 microversion: 2.1 time: 0.736475 Dec 03 15:05:00.412632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 157/318] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:59 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1568 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:00.444069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:00.444863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:00.454246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:00.454885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:00.455822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:00.456392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:00.678715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c575dbd4-8fa8-421e-8987-4f788945f2e6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:00.698315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c575dbd4-8fa8-421e-8987-4f788945f2e6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 1.216722 Dec 03 15:05:00.702383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 162/319] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:04:59 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:00.726560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3d8c3b66-d9b1-4ad6-8fcf-c4d9c0f8ab1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:00.727620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3d8c3b66-d9b1-4ad6-8fcf-c4d9c0f8ab1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:00.745454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d8c3b66-d9b1-4ad6-8fcf-c4d9c0f8ab1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:00.755269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d8c3b66-d9b1-4ad6-8fcf-c4d9c0f8ab1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:00.756850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d8c3b66-d9b1-4ad6-8fcf-c4d9c0f8ab1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:00.757898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d8c3b66-d9b1-4ad6-8fcf-c4d9c0f8ab1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:01.142422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:01.161310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:01.169046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:01.170714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f1863a7a-93f7-47a1-8c1c-45890a587c7e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1743 microversion: 2.20 time: 0.746171 Dec 03 15:05:01.170849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 158/320] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:00 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1743 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:01.194789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-cbeb28bf-93da-40ef-b912-1d11bcb22c4c req-bcd09653-9e43-4bb9-9329-b892508e5d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c340b42-3ca5-4f89-8fc2-c448e784ac83", "tag": "afe54511-8f8c-42eb-8ca3-b2337f457222"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:01.203063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:01.203063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:01.212905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-cbeb28bf-93da-40ef-b912-1d11bcb22c4c req-bcd09653-9e43-4bb9-9329-b892508e5d66 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:01.213745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-cbeb28bf-93da-40ef-b912-1d11bcb22c4c req-bcd09653-9e43-4bb9-9329-b892508e5d66 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:01.235906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-cbeb28bf-93da-40ef-b912-1d11bcb22c4c req-bcd09653-9e43-4bb9-9329-b892508e5d66 service nova] Creating event network-changed:afe54511-8f8c-42eb-8ca3-b2337f457222 for instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 on hv-cinder-75790 Dec 03 15:05:01.241874 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-cbeb28bf-93da-40ef-b912-1d11bcb22c4c req-bcd09653-9e43-4bb9-9329-b892508e5d66 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055956 Dec 03 15:05:01.242590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 159/321] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:01 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:01.258717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c4c9b577-17bb-4697-96ef-5dc59f7b6fef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:01.259498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c4c9b577-17bb-4697-96ef-5dc59f7b6fef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:01.269391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c4c9b577-17bb-4697-96ef-5dc59f7b6fef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:01.269858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c4c9b577-17bb-4697-96ef-5dc59f7b6fef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:01.270736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c4c9b577-17bb-4697-96ef-5dc59f7b6fef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:01.271227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c4c9b577-17bb-4697-96ef-5dc59f7b6fef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:02.121378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3d8c3b66-d9b1-4ad6-8fcf-c4d9c0f8ab1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:02.144927 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3d8c3b66-d9b1-4ad6-8fcf-c4d9c0f8ab1b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 1.441127 Dec 03 15:05:02.158441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 163/322] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:00 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:02.199141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c9eb7bad-f422-4a90-b6db-1732c5ce447f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:02.200135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c9eb7bad-f422-4a90-b6db-1732c5ce447f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:02.221946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c4c9b577-17bb-4697-96ef-5dc59f7b6fef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:02.238050 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9eb7bad-f422-4a90-b6db-1732c5ce447f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:02.238571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9eb7bad-f422-4a90-b6db-1732c5ce447f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:02.239440 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9eb7bad-f422-4a90-b6db-1732c5ce447f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:02.239944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9eb7bad-f422-4a90-b6db-1732c5ce447f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:02.246335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c4c9b577-17bb-4697-96ef-5dc59f7b6fef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 1.001579 Dec 03 15:05:02.246958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 160/323] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:01 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:02.359170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-08e4af33-8897-4b7c-a2c7-b0e4bcd0ad2a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:02.360709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-08e4af33-8897-4b7c-a2c7-b0e4bcd0ad2a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:02.381233 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08e4af33-8897-4b7c-a2c7-b0e4bcd0ad2a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:02.392504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08e4af33-8897-4b7c-a2c7-b0e4bcd0ad2a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:02.400466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08e4af33-8897-4b7c-a2c7-b0e4bcd0ad2a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:02.402536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08e4af33-8897-4b7c-a2c7-b0e4bcd0ad2a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:03.101503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-08e4af33-8897-4b7c-a2c7-b0e4bcd0ad2a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:03.111050 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-08e4af33-8897-4b7c-a2c7-b0e4bcd0ad2a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 0.815545 Dec 03 15:05:03.111656 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 161/324] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:02 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:03.130182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:03.130866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:03.148577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:03.149103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:03.150010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:03.150508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:03.184803 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c9eb7bad-f422-4a90-b6db-1732c5ce447f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:03.207564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c9eb7bad-f422-4a90-b6db-1732c5ce447f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1568 microversion: 2.1 time: 1.047890 Dec 03 15:05:03.214799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 164/325] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:02 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1568 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:03.239773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-b2e9d258-46e3-4984-8bbd-2309409f0f01 req-0a6a1d25-9d4b-4dcd-858b-d2a2d47c6049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5221c6a-cd72-424f-9062-16cf4528384d", "tag": "846d5e26-8d68-4937-b08c-54324832d3bf"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:03.260343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:03.260343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:03.285274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-b2e9d258-46e3-4984-8bbd-2309409f0f01 req-0a6a1d25-9d4b-4dcd-858b-d2a2d47c6049 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:03.285978 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-b2e9d258-46e3-4984-8bbd-2309409f0f01 req-0a6a1d25-9d4b-4dcd-858b-d2a2d47c6049 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:03.321017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-b2e9d258-46e3-4984-8bbd-2309409f0f01 req-0a6a1d25-9d4b-4dcd-858b-d2a2d47c6049 service nova] Creating event network-changed:846d5e26-8d68-4937-b08c-54324832d3bf for instance c5221c6a-cd72-424f-9062-16cf4528384d on hv-cinder-75790 Dec 03 15:05:03.364078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-b2e9d258-46e3-4984-8bbd-2309409f0f01 req-0a6a1d25-9d4b-4dcd-858b-d2a2d47c6049 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147431 Dec 03 15:05:03.370178 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 165/326] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:03 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:03.399712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-837b1b7d-5bfc-41ff-9e63-c59511b735be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:03.406023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-837b1b7d-5bfc-41ff-9e63-c59511b735be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:03.424014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-837b1b7d-5bfc-41ff-9e63-c59511b735be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:03.425654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-837b1b7d-5bfc-41ff-9e63-c59511b735be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:03.427587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-837b1b7d-5bfc-41ff-9e63-c59511b735be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:03.430480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-837b1b7d-5bfc-41ff-9e63-c59511b735be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:03.671580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:03.709031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:03.718011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:03.720499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-53020f05-14f2-4b1d-88b8-3604f92846ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 0.607062 Dec 03 15:05:03.730836 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 162/327] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:03 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:03.756855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e5c9f4d1-b928-44e5-8d0b-7f8d6d315ca6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:03.758124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e5c9f4d1-b928-44e5-8d0b-7f8d6d315ca6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:03.784033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e5c9f4d1-b928-44e5-8d0b-7f8d6d315ca6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:03.784918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e5c9f4d1-b928-44e5-8d0b-7f8d6d315ca6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:03.786035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e5c9f4d1-b928-44e5-8d0b-7f8d6d315ca6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:03.788443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e5c9f4d1-b928-44e5-8d0b-7f8d6d315ca6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:04.250877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e5c9f4d1-b928-44e5-8d0b-7f8d6d315ca6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:04.272302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e5c9f4d1-b928-44e5-8d0b-7f8d6d315ca6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.539612 Dec 03 15:05:04.275110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 163/328] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:03 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:04.286584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-64537bd7-5e9c-4e8e-86e9-b6bee8187ea6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:04.287407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-64537bd7-5e9c-4e8e-86e9-b6bee8187ea6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:04.296651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-64537bd7-5e9c-4e8e-86e9-b6bee8187ea6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:04.297350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-64537bd7-5e9c-4e8e-86e9-b6bee8187ea6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:04.300497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-64537bd7-5e9c-4e8e-86e9-b6bee8187ea6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:04.301163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-64537bd7-5e9c-4e8e-86e9-b6bee8187ea6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:04.587519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-837b1b7d-5bfc-41ff-9e63-c59511b735be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:04.609872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-837b1b7d-5bfc-41ff-9e63-c59511b735be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 1.238009 Dec 03 15:05:04.610526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 166/329] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:03 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:04.637036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-94308605-dad7-44ac-bb61-bbc8a4a664fb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:04.639672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-94308605-dad7-44ac-bb61-bbc8a4a664fb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:04.652091 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-94308605-dad7-44ac-bb61-bbc8a4a664fb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:04.652606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-94308605-dad7-44ac-bb61-bbc8a4a664fb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:04.656121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-94308605-dad7-44ac-bb61-bbc8a4a664fb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:04.657391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-94308605-dad7-44ac-bb61-bbc8a4a664fb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:04.969980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-64537bd7-5e9c-4e8e-86e9-b6bee8187ea6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:05.013255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-64537bd7-5e9c-4e8e-86e9-b6bee8187ea6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 0.736483 Dec 03 15:05:05.014038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 164/330] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:04 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:05.036725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:05.037567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:05.047122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:05.047764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:05.048733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:05.049333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:05.343500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-94308605-dad7-44ac-bb61-bbc8a4a664fb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:05.363236 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-94308605-dad7-44ac-bb61-bbc8a4a664fb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1568 microversion: 2.1 time: 0.746891 Dec 03 15:05:05.366561 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 167/331] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:04 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1568 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:05.396853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e69e3085-1098-4ade-beaf-bbd85a395ae4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:05.400647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e69e3085-1098-4ade-beaf-bbd85a395ae4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:05.421761 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e69e3085-1098-4ade-beaf-bbd85a395ae4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:05.423636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e69e3085-1098-4ade-beaf-bbd85a395ae4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:05.432522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e69e3085-1098-4ade-beaf-bbd85a395ae4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:05.433595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e69e3085-1098-4ade-beaf-bbd85a395ae4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:06.197534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:06.266018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:06.276278 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:06.277987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fecfa4fe-64fd-4503-97a3-61555263f3cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 1.251050 Dec 03 15:05:06.278832 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 165/332] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:05 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:06.289490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e7b78def-d0e5-4a2b-8640-9ed66d02f695 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:06.290497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e7b78def-d0e5-4a2b-8640-9ed66d02f695 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:06.299468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e7b78def-d0e5-4a2b-8640-9ed66d02f695 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:06.300496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e7b78def-d0e5-4a2b-8640-9ed66d02f695 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:06.301862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e7b78def-d0e5-4a2b-8640-9ed66d02f695 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:06.302721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e7b78def-d0e5-4a2b-8640-9ed66d02f695 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:06.776875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e7b78def-d0e5-4a2b-8640-9ed66d02f695 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:06.798722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e7b78def-d0e5-4a2b-8640-9ed66d02f695 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.517693 Dec 03 15:05:06.799871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 166/333] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:06 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:06.812045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cb4a1fda-7cb6-482b-b20e-a3adaaafe5e1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:06.813206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cb4a1fda-7cb6-482b-b20e-a3adaaafe5e1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:06.842600 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb4a1fda-7cb6-482b-b20e-a3adaaafe5e1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:06.843236 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb4a1fda-7cb6-482b-b20e-a3adaaafe5e1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:06.846530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb4a1fda-7cb6-482b-b20e-a3adaaafe5e1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:06.847166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb4a1fda-7cb6-482b-b20e-a3adaaafe5e1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:07.051011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e69e3085-1098-4ade-beaf-bbd85a395ae4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:07.070960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e69e3085-1098-4ade-beaf-bbd85a395ae4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 1.699805 Dec 03 15:05:07.075576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 168/334] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:05 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:07.098001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3a272bc4-acc5-45e9-803e-0a0cd7cac2df tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:07.100287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3a272bc4-acc5-45e9-803e-0a0cd7cac2df tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:07.129210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3a272bc4-acc5-45e9-803e-0a0cd7cac2df tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:07.130613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3a272bc4-acc5-45e9-803e-0a0cd7cac2df tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:07.131915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3a272bc4-acc5-45e9-803e-0a0cd7cac2df tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:07.134594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3a272bc4-acc5-45e9-803e-0a0cd7cac2df tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:07.852562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3a272bc4-acc5-45e9-803e-0a0cd7cac2df tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:07.894110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3a272bc4-acc5-45e9-803e-0a0cd7cac2df tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1568 microversion: 2.1 time: 0.816931 Dec 03 15:05:07.894738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 169/335] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:07 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1568 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:07.919914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:07.923295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:07.936413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:07.936926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:07.937791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:07.938364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:08.232776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cb4a1fda-7cb6-482b-b20e-a3adaaafe5e1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:08.273979 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cb4a1fda-7cb6-482b-b20e-a3adaaafe5e1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 1.466926 Dec 03 15:05:08.274678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 167/336] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:06 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:08.323146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f0492e17-a60b-4fb3-b01b-61d3775b22bb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:08.323829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f0492e17-a60b-4fb3-b01b-61d3775b22bb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:08.382475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0492e17-a60b-4fb3-b01b-61d3775b22bb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:08.383106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0492e17-a60b-4fb3-b01b-61d3775b22bb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:08.384013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0492e17-a60b-4fb3-b01b-61d3775b22bb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:08.384503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0492e17-a60b-4fb3-b01b-61d3775b22bb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:08.569230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:08.606368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:08.615649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:08.621807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d696dc32-9642-4b6d-a5d7-60dca7ac3aa0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 0.726028 Dec 03 15:05:08.634979 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 170/337] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:07 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:08.641525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-24815f71-a785-43e6-b48a-a4b9367ebd07 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:08.642631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-24815f71-a785-43e6-b48a-a4b9367ebd07 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:08.652295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-24815f71-a785-43e6-b48a-a4b9367ebd07 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:08.653157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-24815f71-a785-43e6-b48a-a4b9367ebd07 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:08.654311 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-24815f71-a785-43e6-b48a-a4b9367ebd07 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:08.655245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-24815f71-a785-43e6-b48a-a4b9367ebd07 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:08.907064 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f0492e17-a60b-4fb3-b01b-61d3775b22bb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:08.919185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f0492e17-a60b-4fb3-b01b-61d3775b22bb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.632908 Dec 03 15:05:08.920155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 168/338] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:08 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:08.931454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-42c88024-e387-44ce-a25a-39c719d3ca58 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:08.932485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-42c88024-e387-44ce-a25a-39c719d3ca58 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:08.943036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-42c88024-e387-44ce-a25a-39c719d3ca58 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:08.943917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-42c88024-e387-44ce-a25a-39c719d3ca58 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:08.945931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-42c88024-e387-44ce-a25a-39c719d3ca58 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:08.946647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-42c88024-e387-44ce-a25a-39c719d3ca58 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:09.086970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-24815f71-a785-43e6-b48a-a4b9367ebd07 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:09.109231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-24815f71-a785-43e6-b48a-a4b9367ebd07 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.481592 Dec 03 15:05:09.110237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 171/339] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:08 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:09.308919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-98234daa-e215-439c-9c85-d67d9f5627cc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:09.316828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-98234daa-e215-439c-9c85-d67d9f5627cc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:09.351945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98234daa-e215-439c-9c85-d67d9f5627cc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:09.352757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98234daa-e215-439c-9c85-d67d9f5627cc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:09.354482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98234daa-e215-439c-9c85-d67d9f5627cc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:09.355859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98234daa-e215-439c-9c85-d67d9f5627cc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:09.679261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-42c88024-e387-44ce-a25a-39c719d3ca58 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:09.704476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-42c88024-e387-44ce-a25a-39c719d3ca58 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1568 microversion: 2.1 time: 0.781682 Dec 03 15:05:09.715392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 169/340] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:08 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1568 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:09.751586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:09.758502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:09.798219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-98234daa-e215-439c-9c85-d67d9f5627cc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:09.799507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:09.800345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:09.802692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:09.806445 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:09.850746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-98234daa-e215-439c-9c85-d67d9f5627cc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 0.559537 Dec 03 15:05:09.853019 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 172/341] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:09 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:09.985031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-86068784-d02a-49c7-9800-0812afdd6e90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:09.989379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-86068784-d02a-49c7-9800-0812afdd6e90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:10.039158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86068784-d02a-49c7-9800-0812afdd6e90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:10.044333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86068784-d02a-49c7-9800-0812afdd6e90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:10.045813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86068784-d02a-49c7-9800-0812afdd6e90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:10.047061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86068784-d02a-49c7-9800-0812afdd6e90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:10.518607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:10.536706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:10.550315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:10.552926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ed2476e9-98df-47bb-974d-d1534ee9a1f2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 0.832949 Dec 03 15:05:10.554166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 170/342] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:09 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:10.566879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e73f3627-37db-4fca-a481-239c8f902d65 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:10.567811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e73f3627-37db-4fca-a481-239c8f902d65 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:10.581809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e73f3627-37db-4fca-a481-239c8f902d65 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:10.582910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e73f3627-37db-4fca-a481-239c8f902d65 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:10.584028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e73f3627-37db-4fca-a481-239c8f902d65 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:10.584533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e73f3627-37db-4fca-a481-239c8f902d65 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:10.645506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-86068784-d02a-49c7-9800-0812afdd6e90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:10.694141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-86068784-d02a-49c7-9800-0812afdd6e90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1726 microversion: 2.1 time: 0.759250 Dec 03 15:05:10.700034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 173/343] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:09 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1726 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:10.814094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-921c83e0-dfb7-49b3-8a89-4628e0d1e1e1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:10.816621 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-921c83e0-dfb7-49b3-8a89-4628e0d1e1e1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:10.837618 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-921c83e0-dfb7-49b3-8a89-4628e0d1e1e1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:10.838914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-921c83e0-dfb7-49b3-8a89-4628e0d1e1e1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:10.841950 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-921c83e0-dfb7-49b3-8a89-4628e0d1e1e1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:10.846645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-921c83e0-dfb7-49b3-8a89-4628e0d1e1e1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:11.243337 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e73f3627-37db-4fca-a481-239c8f902d65 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:11.285523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e73f3627-37db-4fca-a481-239c8f902d65 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.726926 Dec 03 15:05:11.286626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 171/344] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:10 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:11.306112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8083cb83-4605-45ba-be82-d43b4932f660 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:11.307007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8083cb83-4605-45ba-be82-d43b4932f660 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:11.332454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8083cb83-4605-45ba-be82-d43b4932f660 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:11.333125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8083cb83-4605-45ba-be82-d43b4932f660 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:11.334857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8083cb83-4605-45ba-be82-d43b4932f660 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:11.342195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8083cb83-4605-45ba-be82-d43b4932f660 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:12.032149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-921c83e0-dfb7-49b3-8a89-4628e0d1e1e1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:12.055194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-921c83e0-dfb7-49b3-8a89-4628e0d1e1e1 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1568 microversion: 2.1 time: 1.260564 Dec 03 15:05:12.058862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 174/345] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:10 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1568 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:12.077173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:12.086389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:12.108275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:12.113794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:12.120519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:12.121632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:12.183521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8083cb83-4605-45ba-be82-d43b4932f660 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:12.204189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8083cb83-4605-45ba-be82-d43b4932f660 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 0.916366 Dec 03 15:05:12.204807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 172/346] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:11 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:12.241033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3743311f-7ada-461f-91aa-0fae667f75d6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:12.241623 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3743311f-7ada-461f-91aa-0fae667f75d6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:12.260734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3743311f-7ada-461f-91aa-0fae667f75d6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:12.261440 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3743311f-7ada-461f-91aa-0fae667f75d6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:12.262094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3743311f-7ada-461f-91aa-0fae667f75d6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:12.262587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3743311f-7ada-461f-91aa-0fae667f75d6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:12.936892 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3743311f-7ada-461f-91aa-0fae667f75d6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:12.959256 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3743311f-7ada-461f-91aa-0fae667f75d6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1703 microversion: 2.1 time: 0.737798 Dec 03 15:05:12.959871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 173/347] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:12 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1703 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:12.980687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-f74b21fa-78a6-45d1-8b4a-1d3425da6c0e req-83a9666c-5660-4e47-b814-45c905964d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c340b42-3ca5-4f89-8fc2-c448e784ac83", "name": "network-vif-plugged", "status": "completed", "tag": "afe54511-8f8c-42eb-8ca3-b2337f457222"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:12.998651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:12.998651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:13.017458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f74b21fa-78a6-45d1-8b4a-1d3425da6c0e req-83a9666c-5660-4e47-b814-45c905964d0f service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:13.018364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f74b21fa-78a6-45d1-8b4a-1d3425da6c0e req-83a9666c-5660-4e47-b814-45c905964d0f service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:13.046835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-f74b21fa-78a6-45d1-8b4a-1d3425da6c0e req-83a9666c-5660-4e47-b814-45c905964d0f service nova] Creating event network-vif-plugged:afe54511-8f8c-42eb-8ca3-b2337f457222 for instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 on hv-cinder-75790 Dec 03 15:05:13.073247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-f74b21fa-78a6-45d1-8b4a-1d3425da6c0e req-83a9666c-5660-4e47-b814-45c905964d0f service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111611 Dec 03 15:05:13.073983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 174/348] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:12 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:13.084398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1e355c08-1a22-4196-902c-46142815ddff tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:13.085170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1e355c08-1a22-4196-902c-46142815ddff tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:13.105895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e355c08-1a22-4196-902c-46142815ddff tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:13.106422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e355c08-1a22-4196-902c-46142815ddff tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:13.107281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e355c08-1a22-4196-902c-46142815ddff tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:13.107837 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e355c08-1a22-4196-902c-46142815ddff tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:13.202055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:13.221303 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:13.234255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:13.235882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-27f7d074-c4ea-481d-8f5b-306a951e1c35 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 1.172781 Dec 03 15:05:13.236706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 175/349] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:12 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:13.254741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b34ebb4e-0b72-4f6f-aa8c-5aec9f5fc63d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:13.263806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b34ebb4e-0b72-4f6f-aa8c-5aec9f5fc63d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:13.265015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b34ebb4e-0b72-4f6f-aa8c-5aec9f5fc63d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:13.348749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b34ebb4e-0b72-4f6f-aa8c-5aec9f5fc63d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Going to try to start instance {{(pid=94373) start /opt/stack/nova/nova/compute/api.py:2599}} Dec 03 15:05:13.535422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b34ebb4e-0b72-4f6f-aa8c-5aec9f5fc63d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 202 len: 0 microversion: 2.1 time: 0.296777 Dec 03 15:05:13.537192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 176/350] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:05:13 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:05:13.552129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1e355c08-1a22-4196-902c-46142815ddff tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:13.557890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e581f92f-0b1e-4b2b-9734-3c8558ab5aba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:13.566297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e581f92f-0b1e-4b2b-9734-3c8558ab5aba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:13.572044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1e355c08-1a22-4196-902c-46142815ddff tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.496598 Dec 03 15:05:13.574764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 175/351] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:13 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:13.589529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e581f92f-0b1e-4b2b-9734-3c8558ab5aba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:13.590358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e581f92f-0b1e-4b2b-9734-3c8558ab5aba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:13.591410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e581f92f-0b1e-4b2b-9734-3c8558ab5aba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:13.592113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e581f92f-0b1e-4b2b-9734-3c8558ab5aba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:13.597279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2c5561bb-a6d5-41b4-bf5b-087e8c2d2efb tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:13.597988 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2c5561bb-a6d5-41b4-bf5b-087e8c2d2efb tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:13.622972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2c5561bb-a6d5-41b4-bf5b-087e8c2d2efb tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:13.623495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2c5561bb-a6d5-41b4-bf5b-087e8c2d2efb tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:13.624806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2c5561bb-a6d5-41b4-bf5b-087e8c2d2efb tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:13.625317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2c5561bb-a6d5-41b4-bf5b-087e8c2d2efb tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:14.097756 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2c5561bb-a6d5-41b4-bf5b-087e8c2d2efb tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:14.107478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2c5561bb-a6d5-41b4-bf5b-087e8c2d2efb tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 0.531369 Dec 03 15:05:14.107996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 176/352] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:13 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:14.122162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-888a59b7-1660-4771-8fdd-d6f3221e1464 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:14.122804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-888a59b7-1660-4771-8fdd-d6f3221e1464 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:14.131415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-888a59b7-1660-4771-8fdd-d6f3221e1464 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:14.131918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-888a59b7-1660-4771-8fdd-d6f3221e1464 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:14.132772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-888a59b7-1660-4771-8fdd-d6f3221e1464 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:14.133260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-888a59b7-1660-4771-8fdd-d6f3221e1464 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:14.404558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-888a59b7-1660-4771-8fdd-d6f3221e1464 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:14.418025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-888a59b7-1660-4771-8fdd-d6f3221e1464 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1712 microversion: 2.1 time: 0.306569 Dec 03 15:05:14.419600 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 177/353] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:14 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1712 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:14.430604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:14.431508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:14.441323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:14.442150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:14.443352 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:14.444012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:14.757848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:14.805389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:14.825400 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:14.847521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0c2f1ded-b312-4d61-820c-0568fab4f556 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 0.426449 Dec 03 15:05:14.857941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 178/354] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:14 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:14.863963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7bf62060-4ed5-4ae1-8de0-04a9459eb0ea tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:14.865433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7bf62060-4ed5-4ae1-8de0-04a9459eb0ea tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:14.879787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7bf62060-4ed5-4ae1-8de0-04a9459eb0ea tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:14.881788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7bf62060-4ed5-4ae1-8de0-04a9459eb0ea tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:14.882952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7bf62060-4ed5-4ae1-8de0-04a9459eb0ea tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:14.883708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7bf62060-4ed5-4ae1-8de0-04a9459eb0ea tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:15.258922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e581f92f-0b1e-4b2b-9734-3c8558ab5aba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:15.279249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e581f92f-0b1e-4b2b-9734-3c8558ab5aba tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1568 microversion: 2.1 time: 1.740669 Dec 03 15:05:15.279854 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 177/355] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:13 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1568 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:15.293483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-942fe70a-5f3d-42c4-93ba-4486b1e3e447 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:15.305713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-942fe70a-5f3d-42c4-93ba-4486b1e3e447 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:15.333496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-942fe70a-5f3d-42c4-93ba-4486b1e3e447 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:15.334039 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-942fe70a-5f3d-42c4-93ba-4486b1e3e447 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:15.334922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-942fe70a-5f3d-42c4-93ba-4486b1e3e447 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:15.335414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-942fe70a-5f3d-42c4-93ba-4486b1e3e447 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:15.740737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7bf62060-4ed5-4ae1-8de0-04a9459eb0ea tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:15.782429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7bf62060-4ed5-4ae1-8de0-04a9459eb0ea tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1359 microversion: 2.1 time: 0.932531 Dec 03 15:05:15.783634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 179/356] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:14 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1359 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:15.794145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ff680bd3-07ea-4a7a-bfb4-935e45dbccb0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:15.801976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ff680bd3-07ea-4a7a-bfb4-935e45dbccb0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:15.818688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff680bd3-07ea-4a7a-bfb4-935e45dbccb0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:15.823197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff680bd3-07ea-4a7a-bfb4-935e45dbccb0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:15.824294 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff680bd3-07ea-4a7a-bfb4-935e45dbccb0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:15.830698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff680bd3-07ea-4a7a-bfb4-935e45dbccb0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:16.153848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ff680bd3-07ea-4a7a-bfb4-935e45dbccb0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:16.163378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ff680bd3-07ea-4a7a-bfb4-935e45dbccb0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1712 microversion: 2.1 time: 0.378368 Dec 03 15:05:16.174283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 180/357] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:15 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1712 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:16.184692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:16.185370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:16.193378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:16.193899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:16.195270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:16.195776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:16.395265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-942fe70a-5f3d-42c4-93ba-4486b1e3e447 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:16.424142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-942fe70a-5f3d-42c4-93ba-4486b1e3e447 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 1.142018 Dec 03 15:05:16.436651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 178/358] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:15 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:16.462451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-690dd7e4-a036-4f63-8041-d9d3c36d8046 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:16.464316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-690dd7e4-a036-4f63-8041-d9d3c36d8046 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:16.486231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-690dd7e4-a036-4f63-8041-d9d3c36d8046 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:16.488061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-690dd7e4-a036-4f63-8041-d9d3c36d8046 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:16.490985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-690dd7e4-a036-4f63-8041-d9d3c36d8046 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:16.491633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-690dd7e4-a036-4f63-8041-d9d3c36d8046 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:17.356450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-690dd7e4-a036-4f63-8041-d9d3c36d8046 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:17.382497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-690dd7e4-a036-4f63-8041-d9d3c36d8046 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1568 microversion: 2.1 time: 0.944299 Dec 03 15:05:17.383115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 179/359] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:16 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1568 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:17.421516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-9216e79e-b870-490d-9836-8e72159b1322 req-c3192c3d-ab26-4c05-bda2-c57b75a3e41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5221c6a-cd72-424f-9062-16cf4528384d", "name": "network-vif-plugged", "status": "completed", "tag": "846d5e26-8d68-4937-b08c-54324832d3bf"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:17.443110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:17.443110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:17.460343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-9216e79e-b870-490d-9836-8e72159b1322 req-c3192c3d-ab26-4c05-bda2-c57b75a3e41e service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:17.465092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-9216e79e-b870-490d-9836-8e72159b1322 req-c3192c3d-ab26-4c05-bda2-c57b75a3e41e service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:17.507209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-9216e79e-b870-490d-9836-8e72159b1322 req-c3192c3d-ab26-4c05-bda2-c57b75a3e41e service nova] Creating event network-vif-plugged:846d5e26-8d68-4937-b08c-54324832d3bf for instance c5221c6a-cd72-424f-9062-16cf4528384d on hv-cinder-75790 Dec 03 15:05:17.523078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-9216e79e-b870-490d-9836-8e72159b1322 req-c3192c3d-ab26-4c05-bda2-c57b75a3e41e service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124226 Dec 03 15:05:17.536573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 180/360] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:17 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:17.555313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4a5f78ec-1804-42c7-b28b-227759b92fed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:17.562275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4a5f78ec-1804-42c7-b28b-227759b92fed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:17.581371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a5f78ec-1804-42c7-b28b-227759b92fed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:17.582319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a5f78ec-1804-42c7-b28b-227759b92fed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:17.587041 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a5f78ec-1804-42c7-b28b-227759b92fed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:17.587880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a5f78ec-1804-42c7-b28b-227759b92fed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:17.642409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:17.674036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:17.696011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:17.698300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e27bddca-b68b-471f-a0de-5ffea5200ab5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 1.522278 Dec 03 15:05:17.700973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 181/361] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:16 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:17.722696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8d2ea308-9501-4468-936d-253d79f15300 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:17.724474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8d2ea308-9501-4468-936d-253d79f15300 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:17.768362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8d2ea308-9501-4468-936d-253d79f15300 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:17.769247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8d2ea308-9501-4468-936d-253d79f15300 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:17.778182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8d2ea308-9501-4468-936d-253d79f15300 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:17.787266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8d2ea308-9501-4468-936d-253d79f15300 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:19.011544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8d2ea308-9501-4468-936d-253d79f15300 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:19.042245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8d2ea308-9501-4468-936d-253d79f15300 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1712 microversion: 2.1 time: 1.339680 Dec 03 15:05:19.071040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 182/362] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:17 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1712 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:19.112516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-843fda21-1cad-4d77-9494-80ac23eb9410 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:19.129619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-843fda21-1cad-4d77-9494-80ac23eb9410 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:19.166774 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-843fda21-1cad-4d77-9494-80ac23eb9410 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:19.167299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-843fda21-1cad-4d77-9494-80ac23eb9410 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:19.168194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-843fda21-1cad-4d77-9494-80ac23eb9410 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:19.168690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-843fda21-1cad-4d77-9494-80ac23eb9410 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:20.102948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-843fda21-1cad-4d77-9494-80ac23eb9410 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:20.132354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-843fda21-1cad-4d77-9494-80ac23eb9410 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 1.048936 Dec 03 15:05:20.133361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 183/363] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:19 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:20.143835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-dd2b6385-49dc-4aef-90a7-9a8ded46a7bb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:20.154934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-dd2b6385-49dc-4aef-90a7-9a8ded46a7bb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:20.171758 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dd2b6385-49dc-4aef-90a7-9a8ded46a7bb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:20.172719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dd2b6385-49dc-4aef-90a7-9a8ded46a7bb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:20.173790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dd2b6385-49dc-4aef-90a7-9a8ded46a7bb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:20.174554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dd2b6385-49dc-4aef-90a7-9a8ded46a7bb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:20.205026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4a5f78ec-1804-42c7-b28b-227759b92fed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:20.215694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4a5f78ec-1804-42c7-b28b-227759b92fed tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1547 microversion: 2.1 time: 2.677061 Dec 03 15:05:20.216537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 181/364] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:17 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1547 bytes in 2679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:20.228009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:20.230595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:20.240293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:20.241073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:20.242161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:20.242832 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:20.661630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dd2b6385-49dc-4aef-90a7-9a8ded46a7bb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:20.678903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-dd2b6385-49dc-4aef-90a7-9a8ded46a7bb tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1548 microversion: 2.1 time: 0.544060 Dec 03 15:05:20.686477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 184/365] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:20 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1548 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:20.708683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d97cf214-5766-4eae-8b7b-c64086f26e9d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:20.718526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d97cf214-5766-4eae-8b7b-c64086f26e9d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:20.733187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d97cf214-5766-4eae-8b7b-c64086f26e9d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:20.733808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d97cf214-5766-4eae-8b7b-c64086f26e9d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:20.735035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d97cf214-5766-4eae-8b7b-c64086f26e9d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:20.735544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d97cf214-5766-4eae-8b7b-c64086f26e9d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:20.985704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:21.038001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:21.060345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:21.066633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-94ca0115-0300-4567-8dcb-833b8c0a9153 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 0.848630 Dec 03 15:05:21.070912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 182/366] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:20 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:21.094313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6686be31-ffd5-4933-a766-5acf3857f055 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:21.096377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6686be31-ffd5-4933-a766-5acf3857f055 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:21.115488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6686be31-ffd5-4933-a766-5acf3857f055 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:21.116869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6686be31-ffd5-4933-a766-5acf3857f055 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:21.118830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6686be31-ffd5-4933-a766-5acf3857f055 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:21.120804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6686be31-ffd5-4933-a766-5acf3857f055 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:21.151792 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d97cf214-5766-4eae-8b7b-c64086f26e9d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:21.163784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d97cf214-5766-4eae-8b7b-c64086f26e9d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1716 microversion: 2.1 time: 0.474447 Dec 03 15:05:21.164657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 185/367] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:20 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1716 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:21.178032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:21.178869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:21.188351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:21.189424 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:21.190537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:21.191595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:21.553429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] HTTP exception thrown: Cannot 'detach_volume' instance c233978f-9c32-47bf-8b66-44f0baa08830 while it is in vm_state rescued Dec 03 15:05:21.554203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Returning 409 to user: Cannot 'detach_volume' instance c233978f-9c32-47bf-8b66-44f0baa08830 while it is in vm_state rescued {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:05:21.555503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9a98b040-0960-4fd9-8c4d-7becb1d50796 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "DELETE /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/os-volume_attachments/d3ee42ee-3766-4b26-b392-a45bf1153784" status: 409 len: 152 microversion: 2.1 time: 0.389656 Dec 03 15:05:21.556397 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 186/368] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:05:21 2020] DELETE /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/os-volume_attachments/d3ee42ee-3766-4b26-b392-a45bf1153784 => generated 152 bytes in 391 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 03 15:05:21.585212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-be825768-dc45-4ebb-a2fb-42a8bd2c78e4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:21.585896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-be825768-dc45-4ebb-a2fb-42a8bd2c78e4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:21.611483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-be825768-dc45-4ebb-a2fb-42a8bd2c78e4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:21.611999 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-be825768-dc45-4ebb-a2fb-42a8bd2c78e4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:21.612877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-be825768-dc45-4ebb-a2fb-42a8bd2c78e4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:21.613377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-be825768-dc45-4ebb-a2fb-42a8bd2c78e4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:21.935710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6686be31-ffd5-4933-a766-5acf3857f055 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:21.967407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6686be31-ffd5-4933-a766-5acf3857f055 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1547 microversion: 2.1 time: 0.894382 Dec 03 15:05:21.989678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 183/369] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:21 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1547 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:22.013874 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8bfe26e2-30fa-40ee-9548-284a7625d85c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:22.017158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8bfe26e2-30fa-40ee-9548-284a7625d85c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:22.036020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8bfe26e2-30fa-40ee-9548-284a7625d85c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.037130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8bfe26e2-30fa-40ee-9548-284a7625d85c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.040486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8bfe26e2-30fa-40ee-9548-284a7625d85c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.041811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8bfe26e2-30fa-40ee-9548-284a7625d85c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.096102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-be825768-dc45-4ebb-a2fb-42a8bd2c78e4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:22.106754 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-be825768-dc45-4ebb-a2fb-42a8bd2c78e4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1312 microversion: 2.1 time: 0.539897 Dec 03 15:05:22.107382 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 187/370] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:21 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1312 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:22.134055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:22.148984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:22.148984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:22.152637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:22.153533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Searching by: {'deleted': False, 'project_id': '26c9d45e8fe5417f944a2053d351ef69'} {{(pid=94374) get_all /opt/stack/nova/nova/compute/api.py:2829}} Dec 03 15:05:22.163806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.164332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.165262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.165754 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.311793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8bfe26e2-30fa-40ee-9548-284a7625d85c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/action" status: 202 len: 0 microversion: 2.1 time: 0.318393 Dec 03 15:05:22.312975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 184/371] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:05:21 2020] POST /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:05:22.340825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.multi_cell_list [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=94374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Dec 03 15:05:22.358131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:22.359177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:22.368169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.368931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.370038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.370665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.507569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ce57beb9-614e-4d51-8d9a-57130c78e74b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.389061 Dec 03 15:05:22.508435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 188/372] 10.222.0.63 () {58 vars in 1115 bytes} [Thu Dec 3 15:05:22 2020] GET /compute/v2.1/servers => generated 343 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:22.520896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-18911cc1-fe2e-4cd7-b508-1b40f3331350 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:22.522528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-18911cc1-fe2e-4cd7-b508-1b40f3331350 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:22.532412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-18911cc1-fe2e-4cd7-b508-1b40f3331350 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.533573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-18911cc1-fe2e-4cd7-b508-1b40f3331350 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.534825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-18911cc1-fe2e-4cd7-b508-1b40f3331350 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.535524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-18911cc1-fe2e-4cd7-b508-1b40f3331350 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.882488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-18911cc1-fe2e-4cd7-b508-1b40f3331350 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:22.916546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-18911cc1-fe2e-4cd7-b508-1b40f3331350 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1556 microversion: 2.1 time: 0.406159 Dec 03 15:05:22.917482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 189/373] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:22 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1556 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:22.927879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-38452f89-9b2f-4ef8-a4af-a69899ae0a6b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:22.928875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-38452f89-9b2f-4ef8-a4af-a69899ae0a6b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:22.938882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38452f89-9b2f-4ef8-a4af-a69899ae0a6b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.939553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38452f89-9b2f-4ef8-a4af-a69899ae0a6b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:22.940593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38452f89-9b2f-4ef8-a4af-a69899ae0a6b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:22.941216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38452f89-9b2f-4ef8-a4af-a69899ae0a6b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:23.243422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:23.286176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:23.302516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:23.304018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-beeed54d-371b-41ba-8ff9-daa07f995693 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 0.989886 Dec 03 15:05:23.308370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 185/374] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:22 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:23.318720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-38452f89-9b2f-4ef8-a4af-a69899ae0a6b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:23.330638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7ba553f3-f16d-4fcb-9e3e-a7a084ce8ebf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:23.338697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7ba553f3-f16d-4fcb-9e3e-a7a084ce8ebf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:23.343274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-38452f89-9b2f-4ef8-a4af-a69899ae0a6b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1547 microversion: 2.1 time: 0.424042 Dec 03 15:05:23.344420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 190/375] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:22 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1547 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:23.365182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ba553f3-f16d-4fcb-9e3e-a7a084ce8ebf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:23.365778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ba553f3-f16d-4fcb-9e3e-a7a084ce8ebf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:23.366543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ba553f3-f16d-4fcb-9e3e-a7a084ce8ebf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:23.367018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ba553f3-f16d-4fcb-9e3e-a7a084ce8ebf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:23.941672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b850316e-823b-4328-b30f-7cf227b8743d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:23.950742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b850316e-823b-4328-b30f-7cf227b8743d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:23.965068 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b850316e-823b-4328-b30f-7cf227b8743d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:23.971102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b850316e-823b-4328-b30f-7cf227b8743d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:23.972171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b850316e-823b-4328-b30f-7cf227b8743d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:23.985348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b850316e-823b-4328-b30f-7cf227b8743d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:24.545617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b850316e-823b-4328-b30f-7cf227b8743d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:24.561872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b850316e-823b-4328-b30f-7cf227b8743d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1556 microversion: 2.1 time: 0.630250 Dec 03 15:05:24.562549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 191/376] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:23 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1556 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:24.591197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:24.591884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:24.600704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:24.601218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:24.602150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:24.602653 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:24.685860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7ba553f3-f16d-4fcb-9e3e-a7a084ce8ebf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:24.716904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7ba553f3-f16d-4fcb-9e3e-a7a084ce8ebf tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1495 microversion: 2.1 time: 1.407168 Dec 03 15:05:24.717504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 186/377] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:23 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1495 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:25.082543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:25.109733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:25.129137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:25.131538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-67e5b6cb-86bf-4de7-8958-5b2bea3877a4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 0.567678 Dec 03 15:05:25.132177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 192/378] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:24 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:25.594591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7af75a8e-0ec7-45f6-96b9-2bc4fd2d4a61 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:25.595395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7af75a8e-0ec7-45f6-96b9-2bc4fd2d4a61 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:25.615762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7af75a8e-0ec7-45f6-96b9-2bc4fd2d4a61 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:25.616383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7af75a8e-0ec7-45f6-96b9-2bc4fd2d4a61 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:25.617477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7af75a8e-0ec7-45f6-96b9-2bc4fd2d4a61 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:25.618105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7af75a8e-0ec7-45f6-96b9-2bc4fd2d4a61 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:25.988288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-265ab06f-e096-4793-a76d-b70cc81ec4d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'create', calling method: .version_select at 0x7fd5f5e57510>, body: {"keypair": {"name": "tempest-TestShelveInstance-1271696383"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:26.060131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-265ab06f-e096-4793-a76d-b70cc81ec4d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Getting quotas for project f77c18074b76496dbbd6d15835f35760. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:05:26.078679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-265ab06f-e096-4793-a76d-b70cc81ec4d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Getting quotas for user db41c9e650f8422f869cd588c90638a9 and project f77c18074b76496dbbd6d15835f35760. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:05:26.176061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7af75a8e-0ec7-45f6-96b9-2bc4fd2d4a61 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:26.196542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7af75a8e-0ec7-45f6-96b9-2bc4fd2d4a61 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1556 microversion: 2.1 time: 0.617127 Dec 03 15:05:26.198056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 193/379] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:25 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1556 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:26.219205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4e8e5d42-dfd8-4cb5-a1f9-e741888ac179 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d6efc0c-ce7b-417c-81ce-40a192f775d3"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:26.220711 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4e8e5d42-dfd8-4cb5-a1f9-e741888ac179 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:26.230058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e8e5d42-dfd8-4cb5-a1f9-e741888ac179 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:26.234930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e8e5d42-dfd8-4cb5-a1f9-e741888ac179 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:26.236117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e8e5d42-dfd8-4cb5-a1f9-e741888ac179 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:26.237116 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e8e5d42-dfd8-4cb5-a1f9-e741888ac179 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:26.477322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-265ab06f-e096-4793-a76d-b70cc81ec4d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Getting quotas for project f77c18074b76496dbbd6d15835f35760. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:05:26.481751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-265ab06f-e096-4793-a76d-b70cc81ec4d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Getting quotas for user db41c9e650f8422f869cd588c90638a9 and project f77c18074b76496dbbd6d15835f35760. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:05:26.497636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-265ab06f-e096-4793-a76d-b70cc81ec4d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.035266 Dec 03 15:05:26.498334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 187/380] 10.222.0.63 () {60 vars in 1148 bytes} [Thu Dec 3 15:05:25 2020] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:26.508299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-faac9a46-fca0-4c31-830e-1a19d663b68c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:26.508860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-faac9a46-fca0-4c31-830e-1a19d663b68c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:26.518499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-faac9a46-fca0-4c31-830e-1a19d663b68c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:26.518719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-faac9a46-fca0-4c31-830e-1a19d663b68c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:26.519498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-faac9a46-fca0-4c31-830e-1a19d663b68c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:26.519991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-faac9a46-fca0-4c31-830e-1a19d663b68c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:26.594030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-faac9a46-fca0-4c31-830e-1a19d663b68c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:05:26.809948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4e8e5d42-dfd8-4cb5-a1f9-e741888ac179 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602107 Dec 03 15:05:26.811326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 194/381] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:05:26 2020] POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:26.847351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:26.854509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:26.883949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:26.884802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:26.890322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:26.890945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:26.968890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-faac9a46-fca0-4c31-830e-1a19d663b68c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "DELETE /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 204 len: 0 microversion: 2.1 time: 0.468426 Dec 03 15:05:26.969657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 188/382] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:05:26 2020] DELETE /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:05:26.984534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-34bf051d-e114-493c-9618-b6d64f6fbd85 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'create', calling method: .version_select at 0x7fd5f69e48c8>, body: {"security_group": {"name": "tempest-TestShelveInstance-1314101855", "description": "tempest-TestShelveInstance-1314101855 description"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:27.315974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-34bf051d-e114-493c-9618-b6d64f6fbd85 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.344508 Dec 03 15:05:27.323261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 189/383] 10.222.0.63 () {60 vars in 1170 bytes} [Thu Dec 3 15:05:26 2020] POST /compute/v2.1/os-security-groups => generated 245 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:27.324908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:27.331000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2d12515b-e6ef-4598-be43-0863e1feb135 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:27.332215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2d12515b-e6ef-4598-be43-0863e1feb135 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:27.342662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:27.342901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2d12515b-e6ef-4598-be43-0863e1feb135 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:27.343389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2d12515b-e6ef-4598-be43-0863e1feb135 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:27.344408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2d12515b-e6ef-4598-be43-0863e1feb135 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:27.345080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2d12515b-e6ef-4598-be43-0863e1feb135 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:27.350486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:27.351749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-df828736-13c4-4833-a16e-9c5892700145 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1738 microversion: 2.20 time: 0.521894 Dec 03 15:05:27.352349 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 195/384] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:26 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1738 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:27.362685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8c6fe1c9-f908-482f-a375-edefdb723926 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:27.363360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8c6fe1c9-f908-482f-a375-edefdb723926 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:27.373737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c6fe1c9-f908-482f-a375-edefdb723926 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:27.374466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c6fe1c9-f908-482f-a375-edefdb723926 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:27.375351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c6fe1c9-f908-482f-a375-edefdb723926 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:27.375842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c6fe1c9-f908-482f-a375-edefdb723926 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:27.605136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2d12515b-e6ef-4598-be43-0863e1feb135 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:27.616619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2d12515b-e6ef-4598-be43-0863e1feb135 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1501 microversion: 2.1 time: 0.298395 Dec 03 15:05:27.628009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 190/385] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:27 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1501 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:27.630882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8c6fe1c9-f908-482f-a375-edefdb723926 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:27.639483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6238a4cc-db9f-4439-a4c9-65431c90e349 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'create', calling method: .version_select at 0x7fd5f69e4048>, body: {"security_group_rule": {"parent_group_id": "e36ef011-09e2-4558-934b-b2128a1b6126", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:27.642181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8c6fe1c9-f908-482f-a375-edefdb723926 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1556 microversion: 2.1 time: 0.288349 Dec 03 15:05:27.642872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 196/386] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:27 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1556 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:27.882389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6238a4cc-db9f-4439-a4c9-65431c90e349 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.263954 Dec 03 15:05:27.883125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 191/387] 10.222.0.63 () {60 vars in 1185 bytes} [Thu Dec 3 15:05:27 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:27.899664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c40536b3-b043-4df7-b698-13372ee61160 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'create', calling method: .version_select at 0x7fd5f6a15a60>, body: {"security_group_rule": {"parent_group_id": "e36ef011-09e2-4558-934b-b2128a1b6126", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:28.176565 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c40536b3-b043-4df7-b698-13372ee61160 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.285875 Dec 03 15:05:28.177506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 197/388] 10.222.0.63 () {60 vars in 1185 bytes} [Thu Dec 3 15:05:27 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:28.380266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:28.380862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:28.396808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:28.397322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:28.398227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:28.398732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:28.642110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c0b1b934-2819-4c52-9a63-0e3359c32fa6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:28.643080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c0b1b934-2819-4c52-9a63-0e3359c32fa6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:28.653417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0b1b934-2819-4c52-9a63-0e3359c32fa6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:28.654333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0b1b934-2819-4c52-9a63-0e3359c32fa6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:28.655740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0b1b934-2819-4c52-9a63-0e3359c32fa6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:28.656436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0b1b934-2819-4c52-9a63-0e3359c32fa6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:28.767968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:28.816290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:28.830174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:28.835860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5761f9e9-7ff5-42a9-991e-85aab6e11071 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1720 microversion: 2.20 time: 0.469539 Dec 03 15:05:28.841434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 192/389] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:28 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1720 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:28.867125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eb262095-180b-49bc-9e04-05f8ec3c60c5 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:28.867823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-eb262095-180b-49bc-9e04-05f8ec3c60c5 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:28.887340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb262095-180b-49bc-9e04-05f8ec3c60c5 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:28.887855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb262095-180b-49bc-9e04-05f8ec3c60c5 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:28.888715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb262095-180b-49bc-9e04-05f8ec3c60c5 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:28.889219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb262095-180b-49bc-9e04-05f8ec3c60c5 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:28.952597 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c0b1b934-2819-4c52-9a63-0e3359c32fa6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:28.962874 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c0b1b934-2819-4c52-9a63-0e3359c32fa6 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1501 microversion: 2.1 time: 0.331160 Dec 03 15:05:28.965293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 198/390] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:28 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:29.306372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-eb262095-180b-49bc-9e04-05f8ec3c60c5 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:29.317974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eb262095-180b-49bc-9e04-05f8ec3c60c5 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1562 microversion: 2.1 time: 0.474989 Dec 03 15:05:29.322613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 193/391] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:28 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1562 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:29.476188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7ea3e151-74e2-4135-9d30-8453961e4108 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:29.476602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7ea3e151-74e2-4135-9d30-8453961e4108 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:29.493540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ea3e151-74e2-4135-9d30-8453961e4108 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:29.498545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ea3e151-74e2-4135-9d30-8453961e4108 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:29.499509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ea3e151-74e2-4135-9d30-8453961e4108 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:29.500101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ea3e151-74e2-4135-9d30-8453961e4108 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:29.865477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:29.870652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:29.902557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:29.903610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:29.904489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:29.904965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:29.956244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7ea3e151-74e2-4135-9d30-8453961e4108 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "DELETE /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/os-volume_attachments/d3ee42ee-3766-4b26-b392-a45bf1153784" status: 202 len: 0 microversion: 2.1 time: 0.490571 Dec 03 15:05:29.957075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 199/392] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:05:29 2020] DELETE /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830/os-volume_attachments/d3ee42ee-3766-4b26-b392-a45bf1153784 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:05:30.002566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6dac7ae7-0db9-41e8-ad0c-b9150ed96c9f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:30.006805 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6dac7ae7-0db9-41e8-ad0c-b9150ed96c9f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:30.038596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6dac7ae7-0db9-41e8-ad0c-b9150ed96c9f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:30.039224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6dac7ae7-0db9-41e8-ad0c-b9150ed96c9f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:30.040188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6dac7ae7-0db9-41e8-ad0c-b9150ed96c9f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:30.040970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6dac7ae7-0db9-41e8-ad0c-b9150ed96c9f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:30.496852 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:30.518200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:30.520887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:30.523049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7d88d9f1-f944-4eac-81aa-385b746036fc tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1720 microversion: 2.20 time: 0.666590 Dec 03 15:05:30.523888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 194/393] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:29 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1720 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:30.541212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-1c782fa3-9efc-463c-afe0-3be709ccc29f req-94004050-3de1-4fbe-a2f6-26957d3c9d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5221c6a-cd72-424f-9062-16cf4528384d", "name": "network-vif-unplugged", "status": "completed", "tag": "846d5e26-8d68-4937-b08c-54324832d3bf"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:30.548338 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:30.548338 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:30.558703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-1c782fa3-9efc-463c-afe0-3be709ccc29f req-94004050-3de1-4fbe-a2f6-26957d3c9d3e service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:30.559200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-1c782fa3-9efc-463c-afe0-3be709ccc29f req-94004050-3de1-4fbe-a2f6-26957d3c9d3e service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:30.580203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-1c782fa3-9efc-463c-afe0-3be709ccc29f req-94004050-3de1-4fbe-a2f6-26957d3c9d3e service nova] Creating event network-vif-unplugged:846d5e26-8d68-4937-b08c-54324832d3bf for instance c5221c6a-cd72-424f-9062-16cf4528384d on hv-cinder-75790 Dec 03 15:05:30.585634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-1c782fa3-9efc-463c-afe0-3be709ccc29f req-94004050-3de1-4fbe-a2f6-26957d3c9d3e service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060266 Dec 03 15:05:30.586649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 195/394] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:30 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:30.956840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6dac7ae7-0db9-41e8-ad0c-b9150ed96c9f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:30.966868 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6dac7ae7-0db9-41e8-ad0c-b9150ed96c9f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1501 microversion: 2.1 time: 0.987766 Dec 03 15:05:30.967481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 200/395] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:29 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1501 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:31.551615 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:31.552473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:31.562282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:31.563247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:31.564336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:31.565348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:31.826222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:31.841193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:31.848479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:31.849686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0281c8e9-3dfe-454a-a856-cdede6d790f0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1720 microversion: 2.20 time: 0.308854 Dec 03 15:05:31.850301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 196/396] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:31 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:31.995764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-62958d48-1772-4c0e-8e45-f2936cd529a1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:31.996447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-62958d48-1772-4c0e-8e45-f2936cd529a1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:32.004479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-62958d48-1772-4c0e-8e45-f2936cd529a1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:32.004958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-62958d48-1772-4c0e-8e45-f2936cd529a1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:32.005858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-62958d48-1772-4c0e-8e45-f2936cd529a1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:32.006326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-62958d48-1772-4c0e-8e45-f2936cd529a1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:32.460771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-62958d48-1772-4c0e-8e45-f2936cd529a1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:32.472234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-62958d48-1772-4c0e-8e45-f2936cd529a1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1501 microversion: 2.1 time: 0.487983 Dec 03 15:05:32.473023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 201/397] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:31 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1501 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:32.531721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-9f29f9c4-c94d-45cc-9e99-7f23f436545b req-d0dd95a4-972f-4c72-8874-0f9c37b27fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5221c6a-cd72-424f-9062-16cf4528384d", "name": "network-vif-deleted", "tag": "846d5e26-8d68-4937-b08c-54324832d3bf"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:32.538638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:32.538638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:32.548341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-9f29f9c4-c94d-45cc-9e99-7f23f436545b req-d0dd95a4-972f-4c72-8874-0f9c37b27fcd service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:32.548838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-9f29f9c4-c94d-45cc-9e99-7f23f436545b req-d0dd95a4-972f-4c72-8874-0f9c37b27fcd service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:32.566904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-9f29f9c4-c94d-45cc-9e99-7f23f436545b req-d0dd95a4-972f-4c72-8874-0f9c37b27fcd service nova] Creating event network-vif-deleted:846d5e26-8d68-4937-b08c-54324832d3bf for instance c5221c6a-cd72-424f-9062-16cf4528384d on hv-cinder-75790 Dec 03 15:05:32.571718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-9f29f9c4-c94d-45cc-9e99-7f23f436545b req-d0dd95a4-972f-4c72-8874-0f9c37b27fcd service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049930 Dec 03 15:05:32.572386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 197/398] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:32 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:32.875732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:32.876412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:32.884281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:32.884899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:32.885737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:32.886248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:33.119301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:33.135167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:33.141922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:33.143150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-87904ae2-68e7-491c-b5e2-830aea4e5e4c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1720 microversion: 2.20 time: 0.278432 Dec 03 15:05:33.143738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 202/399] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:32 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1720 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:33.498320 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:33.499097 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:33.507099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:33.507609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:33.508451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:33.508950 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:33.589803 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:33.590346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:33.590849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lazy-loading 'fault' on Instance uuid c5221c6a-cd72-424f-9062-16cf4528384d {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:05:33.658842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:33.668215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6f117b29-77ef-4b4b-bc2e-00c0cb9955fc tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 200 len: 1302 microversion: 2.1 time: 0.180313 Dec 03 15:05:33.668810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 198/400] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:33 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 1302 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:34.168906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:34.169575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:34.178553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:34.179057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:34.180153 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:34.180655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:34.404800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-1d30995a-e452-464b-8a16-8f6ad66696ea req-a0ae6ae9-0c0d-414c-bc42-2134f542ebab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53f7d53-2ae6-4edd-84c2-09e523498d7d", "name": "network-vif-unplugged", "status": "completed", "tag": "6e8050ed-0789-4bcc-bbe2-11f953a2e2ed"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:34.411911 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:34.411911 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:34.422288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-1d30995a-e452-464b-8a16-8f6ad66696ea req-a0ae6ae9-0c0d-414c-bc42-2134f542ebab service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:34.422736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-1d30995a-e452-464b-8a16-8f6ad66696ea req-a0ae6ae9-0c0d-414c-bc42-2134f542ebab service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:34.427531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:34.442769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.compute.server_external_events [req-1d30995a-e452-464b-8a16-8f6ad66696ea req-a0ae6ae9-0c0d-414c-bc42-2134f542ebab service nova] Unable to find a host for instance f53f7d53-2ae6-4edd-84c2-09e523498d7d. Dropping event network-vif-unplugged {{(pid=94373) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Dec 03 15:05:34.444405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-1d30995a-e452-464b-8a16-8f6ad66696ea req-a0ae6ae9-0c0d-414c-bc42-2134f542ebab service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052156 Dec 03 15:05:34.444405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 199/401] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:34 2020] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 03 15:05:34.445527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:34.453356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:34.454625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-286599a2-c9ca-4a50-b2f5-e48fa7159702 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1723 microversion: 2.20 time: 0.295443 Dec 03 15:05:34.455211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 203/402] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:34 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:34.480593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1ecc9aed-1803-44b6-bc38-afab7eb4f035 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "647fb357-21e8-4deb-a2af-d2e066d8090a"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:34.481871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1ecc9aed-1803-44b6-bc38-afab7eb4f035 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:34.490025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1ecc9aed-1803-44b6-bc38-afab7eb4f035 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:34.490553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1ecc9aed-1803-44b6-bc38-afab7eb4f035 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:34.491725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1ecc9aed-1803-44b6-bc38-afab7eb4f035 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:34.491819 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1ecc9aed-1803-44b6-bc38-afab7eb4f035 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:34.693649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:34.694795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: c5221c6a-cd72-424f-9062-16cf4528384d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:34.703917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:34.704425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:34.705276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:34.705769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:34.772542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] HTTP exception thrown: Instance c5221c6a-cd72-424f-9062-16cf4528384d could not be found. Dec 03 15:05:34.773326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Returning 404 to user: Instance c5221c6a-cd72-424f-9062-16cf4528384d could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:05:34.774469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7bcc5df4-c6a9-4948-b39a-bcc310fef902 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d" status: 404 len: 111 microversion: 2.1 time: 0.091187 Dec 03 15:05:34.775708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 204/403] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:34 2020] GET /compute/v2.1/servers/c5221c6a-cd72-424f-9062-16cf4528384d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:05:34.920819 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-76377985", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "7563c63a-7ae2-448f-9a35-0b81ebf9961f"}]}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:35.014633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] validate_networks() for [('7563c63a-7ae2-448f-9a35-0b81ebf9961f', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:05:35.063047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1ecc9aed-1803-44b6-bc38-afab7eb4f035 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.591881 Dec 03 15:05:35.063834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 200/404] 10.222.0.63 () {62 vars in 1354 bytes} [Thu Dec 3 15:05:34 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/os-volume_attachments => generated 188 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:05:35.187547 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-50050a20-ba16-4b26-983f-339a07989597 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:35.188176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-50050a20-ba16-4b26-983f-339a07989597 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:35.196235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50050a20-ba16-4b26-983f-339a07989597 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:35.196692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50050a20-ba16-4b26-983f-339a07989597 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:35.197934 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50050a20-ba16-4b26-983f-339a07989597 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:35.198509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50050a20-ba16-4b26-983f-339a07989597 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:35.360963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-50050a20-ba16-4b26-983f-339a07989597 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action" status: 202 len: 0 microversion: 2.20 time: 0.183635 Dec 03 15:05:35.365826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 201/405] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:05:35 2020] POST /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 03 15:05:35.379246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:35.379969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:35.388975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:35.389489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:35.390410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:35.390918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:35.605437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:05:35.605944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:05:35.606506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:05:35.606978 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:05:35.607454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:05:35.621164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:35.621796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:35.622983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:35.623580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:35.646326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Getting quotas for project ce1ba93ac65044e99ad68789f769dd71. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:05:35.652090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Getting quotas for user 042d0d7452254183ba3531b7c01a830b and project ce1ba93ac65044e99ad68789f769dd71. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:05:35.665854 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:05:35.668838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:05:35.771541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-38624e4b-8c38-41d1-9db5-758126db7f04 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860140 Dec 03 15:05:35.778515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 205/406] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:05:34 2020] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 03 15:05:35.817855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a0dccd53-029b-48cc-872b-62add1b16d7a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:35.818600 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a0dccd53-029b-48cc-872b-62add1b16d7a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:35.956140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:35.963859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a0dccd53-029b-48cc-872b-62add1b16d7a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:35.973585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a0dccd53-029b-48cc-872b-62add1b16d7a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1212 microversion: 2.1 time: 0.192557 Dec 03 15:05:35.974133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:35.974468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 206/407] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:35 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1212 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:35.982125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:35.983623 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0d50b765-514a-43e1-a2f6-0232160365ef tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1749 microversion: 2.20 time: 0.616150 Dec 03 15:05:35.984690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 202/408] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:35 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1749 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:36.360778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b2fe2d24-0b72-4724-8125-033879c3c5f1 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:36.361431 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b2fe2d24-0b72-4724-8125-033879c3c5f1 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:36.369693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2fe2d24-0b72-4724-8125-033879c3c5f1 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:36.370276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2fe2d24-0b72-4724-8125-033879c3c5f1 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:36.371119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2fe2d24-0b72-4724-8125-033879c3c5f1 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:36.371587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2fe2d24-0b72-4724-8125-033879c3c5f1 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:36.615274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b2fe2d24-0b72-4724-8125-033879c3c5f1 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:36.625431 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b2fe2d24-0b72-4724-8125-033879c3c5f1 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1593 microversion: 2.1 time: 0.274415 Dec 03 15:05:36.626568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 207/409] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:36 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1593 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:36.649475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c5a83e16-9c4b-4b8c-ab71-3a4e14381bad tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'create', calling method: .version_select at 0x7fd5f61390d0>, body: {"pool": null} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:36.999026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4d0275c8-d2c8-4bd0-a5e0-7349c734edd4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:37.000288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4d0275c8-d2c8-4bd0-a5e0-7349c734edd4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:37.008460 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d0275c8-d2c8-4bd0-a5e0-7349c734edd4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:37.008955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d0275c8-d2c8-4bd0-a5e0-7349c734edd4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:37.010787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d0275c8-d2c8-4bd0-a5e0-7349c734edd4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:37.011357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d0275c8-d2c8-4bd0-a5e0-7349c734edd4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:37.153619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4d0275c8-d2c8-4bd0-a5e0-7349c734edd4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:37.162778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4d0275c8-d2c8-4bd0-a5e0-7349c734edd4 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1264 microversion: 2.1 time: 0.174428 Dec 03 15:05:37.163362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 208/410] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:36 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:37.174251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:37.175152 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:37.183589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:37.184242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:37.185053 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:37.185579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:37.424215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:37.441543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:37.449560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:37.450884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a641848d-514c-4140-a20c-786b2980e236 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1751 microversion: 2.20 time: 0.286234 Dec 03 15:05:37.451490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 209/411] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:37 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1751 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:38.188305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-abec653d-bfa4-42d5-9def-52de49a3c59f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:38.188958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-abec653d-bfa4-42d5-9def-52de49a3c59f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:38.199537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abec653d-bfa4-42d5-9def-52de49a3c59f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:38.200486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abec653d-bfa4-42d5-9def-52de49a3c59f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:38.201508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abec653d-bfa4-42d5-9def-52de49a3c59f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:38.202194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abec653d-bfa4-42d5-9def-52de49a3c59f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:38.497073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-abec653d-bfa4-42d5-9def-52de49a3c59f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:38.506243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-abec653d-bfa4-42d5-9def-52de49a3c59f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1270 microversion: 2.1 time: 0.328194 Dec 03 15:05:38.507026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 210/412] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:38 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1270 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:38.521676 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:38.522748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:38.532026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:38.532555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:38.533398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:38.533892 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:38.997122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:39.013483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:39.021007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:39.022977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bbcd7fde-a4a3-4ae9-818c-e9183979bbca tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1751 microversion: 2.20 time: 0.511529 Dec 03 15:05:39.024550 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 211/413] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:38 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1751 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:39.484912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c5a83e16-9c4b-4b8c-ab71-3a4e14381bad tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.845543 Dec 03 15:05:39.485556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 203/414] 10.222.0.63 () {60 vars in 1160 bytes} [Thu Dec 3 15:05:36 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:39.514181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'action', calling method: .version_select at 0x7fd5f76e2488>, body: {"addFloatingIp": {"address": "172.27.2.201"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:39.516034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:39.525524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:39.527188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:39.528651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:39.529279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:39.531457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-48727450-df14-4001-b7d1-663f4e88b5ce tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:39.536078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-48727450-df14-4001-b7d1-663f4e88b5ce tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:39.558674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48727450-df14-4001-b7d1-663f4e88b5ce tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:39.562036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48727450-df14-4001-b7d1-663f4e88b5ce tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:39.563082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48727450-df14-4001-b7d1-663f4e88b5ce tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:39.566598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48727450-df14-4001-b7d1-663f4e88b5ce tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:39.616477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Acquired lock "refresh_cache-0c340b42-3ca5-4f89-8fc2-c448e784ac83" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:05:39.956423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-48727450-df14-4001-b7d1-663f4e88b5ce tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:39.967060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-48727450-df14-4001-b7d1-663f4e88b5ce tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.446814 Dec 03 15:05:39.967693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 204/415] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:39 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:39.986491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5b794827-db88-4d85-b022-36c41765a41f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:39.987133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5b794827-db88-4d85-b022-36c41765a41f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:39.996090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5b794827-db88-4d85-b022-36c41765a41f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:39.996687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5b794827-db88-4d85-b022-36c41765a41f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:39.998529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5b794827-db88-4d85-b022-36c41765a41f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:39.999112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5b794827-db88-4d85-b022-36c41765a41f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:40.078530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5b794827-db88-4d85-b022-36c41765a41f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:05:40.207208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5b794827-db88-4d85-b022-36c41765a41f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "DELETE /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 204 len: 0 microversion: 2.1 time: 0.237913 Dec 03 15:05:40.208148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 205/416] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:05:39 2020] DELETE /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:05:40.220480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:40.221401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:40.229287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:40.229790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:40.230762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:40.231261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:40.495117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:40.512104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:40.518755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:40.519957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-47ef52f5-d457-4dc2-b854-ead20a34bbe3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1751 microversion: 2.20 time: 0.310756 Dec 03 15:05:40.520552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 206/417] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:40 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1751 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:40.530899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6b5d36af-097b-47ad-ac07-fbc68c92750d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:40.531572 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6b5d36af-097b-47ad-ac07-fbc68c92750d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:40.539336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6b5d36af-097b-47ad-ac07-fbc68c92750d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:40.539851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6b5d36af-097b-47ad-ac07-fbc68c92750d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:40.540739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6b5d36af-097b-47ad-ac07-fbc68c92750d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:40.541481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6b5d36af-097b-47ad-ac07-fbc68c92750d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:40.773861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6b5d36af-097b-47ad-ac07-fbc68c92750d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:40.792935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6b5d36af-097b-47ad-ac07-fbc68c92750d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.271214 Dec 03 15:05:40.793777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 207/418] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:40 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:40.991770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1b50a316-5c53-40f3-b5a4-f49a5211ad50 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:40.992483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1b50a316-5c53-40f3-b5a4-f49a5211ad50 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:41.001246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1b50a316-5c53-40f3-b5a4-f49a5211ad50 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:41.001602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1b50a316-5c53-40f3-b5a4-f49a5211ad50 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:41.002471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1b50a316-5c53-40f3-b5a4-f49a5211ad50 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:41.003028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1b50a316-5c53-40f3-b5a4-f49a5211ad50 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:41.242762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1b50a316-5c53-40f3-b5a4-f49a5211ad50 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:41.252804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1b50a316-5c53-40f3-b5a4-f49a5211ad50 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.270795 Dec 03 15:05:41.253402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 208/419] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:40 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:41.546891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:41.547574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:41.555946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:41.556546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:41.557421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:41.557945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:41.882901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:41.920161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:41.939044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:41.952789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ee1171e3-0314-4411-b6d7-76c7df17739f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.416036 Dec 03 15:05:41.953533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 209/420] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:41 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:05:41.964901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-31b53e73-d0bf-4072-a52f-856222e10159 req-3f56a672-b784-4351-a9a2-e8a1b220cbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336d98ca-1548-4d14-87f5-274050e7a048", "tag": "39d702b9-440e-4c01-93b9-46950f0484b3"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:41.972410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:41.972410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:41.982054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-31b53e73-d0bf-4072-a52f-856222e10159 req-3f56a672-b784-4351-a9a2-e8a1b220cbaa service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:41.982739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-31b53e73-d0bf-4072-a52f-856222e10159 req-3f56a672-b784-4351-a9a2-e8a1b220cbaa service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:42.013526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-31b53e73-d0bf-4072-a52f-856222e10159 req-3f56a672-b784-4351-a9a2-e8a1b220cbaa service nova] Creating event network-changed:39d702b9-440e-4c01-93b9-46950f0484b3 for instance 336d98ca-1548-4d14-87f5-274050e7a048 on hv-cinder-75790 Dec 03 15:05:42.019396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-31b53e73-d0bf-4072-a52f-856222e10159 req-3f56a672-b784-4351-a9a2-e8a1b220cbaa service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064419 Dec 03 15:05:42.020725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 210/421] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:41 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:42.033087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ce88055c-2d34-4500-ba5d-ce35a2b4ef47 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:42.034192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ce88055c-2d34-4500-ba5d-ce35a2b4ef47 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:42.043369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce88055c-2d34-4500-ba5d-ce35a2b4ef47 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:42.044204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce88055c-2d34-4500-ba5d-ce35a2b4ef47 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:42.045274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce88055c-2d34-4500-ba5d-ce35a2b4ef47 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:42.046058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ce88055c-2d34-4500-ba5d-ce35a2b4ef47 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:42.322807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ce88055c-2d34-4500-ba5d-ce35a2b4ef47 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:42.332271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ce88055c-2d34-4500-ba5d-ce35a2b4ef47 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.310151 Dec 03 15:05:42.333109 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 211/422] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:42 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:42.355094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-70b60f1b-1740-4f14-8828-53dafb4d498c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:42.355968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-70b60f1b-1740-4f14-8828-53dafb4d498c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:42.367371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-70b60f1b-1740-4f14-8828-53dafb4d498c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:42.367884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-70b60f1b-1740-4f14-8828-53dafb4d498c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:42.368976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-70b60f1b-1740-4f14-8828-53dafb4d498c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:42.369645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-70b60f1b-1740-4f14-8828-53dafb4d498c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:42.616102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Building network info cache for instance {{(pid=94374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:05:42.730013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-70b60f1b-1740-4f14-8828-53dafb4d498c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:42.741677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-70b60f1b-1740-4f14-8828-53dafb4d498c tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.407620 Dec 03 15:05:42.742718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 212/423] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:42 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:42.984651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:42.985326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:42.995356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:42.995877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:42.996813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:42.997409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:43.365703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:43.383177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:43.391652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:43.392923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3f30ac73-3d62-4520-bfee-4c615bab29e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.418698 Dec 03 15:05:43.393708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 213/424] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:42 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:43.413035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-896820d7-98a0-4eaa-9096-d79d5639b633 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:43.414255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-896820d7-98a0-4eaa-9096-d79d5639b633 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:43.444717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-896820d7-98a0-4eaa-9096-d79d5639b633 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:43.445235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-896820d7-98a0-4eaa-9096-d79d5639b633 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:43.446155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-896820d7-98a0-4eaa-9096-d79d5639b633 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:43.447187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-896820d7-98a0-4eaa-9096-d79d5639b633 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:43.710250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Updating instance_info_cache with network_info: [{"id": "afe54511-8f8c-42eb-8ca3-b2337f457222", "address": "fa:16:3e:2f:ec:69", "network": {"id": "52cd6ebc-32b4-40f6-9b98-6760dd6218f7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-88033544-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26c9d45e8fe5417f944a2053d351ef69", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapafe54511-8f", "ovs_interfaceid": "afe54511-8f8c-42eb-8ca3-b2337f457222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:05:43.731228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Releasing lock "refresh_cache-0c340b42-3ca5-4f89-8fc2-c448e784ac83" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:05:43.732447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ced5d8a7-eaa6-4b39-a128-1c4c4b287141 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/action" status: 202 len: 0 microversion: 2.1 time: 4.239450 Dec 03 15:05:43.733430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 212/425] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:05:39 2020] POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/action => generated 0 bytes in 4241 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 15:05:43.773289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d86fcf89-cb1b-4b36-9353-07703c5fbbd2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'create', calling method: .version_select at 0x7fd5f5703d90>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-35739318", "description": "tempest-TestMinimumBasicScenario-35739318 description"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:43.817114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-896820d7-98a0-4eaa-9096-d79d5639b633 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:43.838672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-896820d7-98a0-4eaa-9096-d79d5639b633 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.436350 Dec 03 15:05:43.839309 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 214/426] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:43 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:43.867012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ef66bccb-79ec-439d-85b1-19c5aaff9220 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:43.867699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ef66bccb-79ec-439d-85b1-19c5aaff9220 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:43.879243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ef66bccb-79ec-439d-85b1-19c5aaff9220 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:43.879755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ef66bccb-79ec-439d-85b1-19c5aaff9220 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:43.881029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ef66bccb-79ec-439d-85b1-19c5aaff9220 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:43.881530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ef66bccb-79ec-439d-85b1-19c5aaff9220 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:44.137447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d86fcf89-cb1b-4b36-9353-07703c5fbbd2 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.394019 Dec 03 15:05:44.138613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 213/427] 10.222.0.63 () {60 vars in 1170 bytes} [Thu Dec 3 15:05:43 2020] POST /compute/v2.1/os-security-groups => generated 253 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:44.166265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ef66bccb-79ec-439d-85b1-19c5aaff9220 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:44.175896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ef66bccb-79ec-439d-85b1-19c5aaff9220 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.318131 Dec 03 15:05:44.176855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 215/428] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:43 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:44.177217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-d1574a5d-eeb4-4f61-899e-7c7e5d54c790 req-5fa4600b-9127-4597-8f49-0343343abb73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c340b42-3ca5-4f89-8fc2-c448e784ac83", "tag": "afe54511-8f8c-42eb-8ca3-b2337f457222"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:44.190970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a4b44dfb-d14c-4524-bc0a-e4387637b499 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'create', calling method: .version_select at 0x7fd5f5e57840>, body: {"security_group_rule": {"parent_group_id": "5ffdf135-388f-48b5-bce4-3a1c9059bc68", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:44.205109 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:44.205109 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:44.220319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d1574a5d-eeb4-4f61-899e-7c7e5d54c790 req-5fa4600b-9127-4597-8f49-0343343abb73 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:44.221196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d1574a5d-eeb4-4f61-899e-7c7e5d54c790 req-5fa4600b-9127-4597-8f49-0343343abb73 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:44.241161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-d1574a5d-eeb4-4f61-899e-7c7e5d54c790 req-5fa4600b-9127-4597-8f49-0343343abb73 service nova] Creating event network-changed:afe54511-8f8c-42eb-8ca3-b2337f457222 for instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 on hv-cinder-75790 Dec 03 15:05:44.248376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-d1574a5d-eeb4-4f61-899e-7c7e5d54c790 req-5fa4600b-9127-4597-8f49-0343343abb73 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107850 Dec 03 15:05:44.250621 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 214/429] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:44 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:44.421073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:44.422140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:44.432937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:44.433729 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:44.434633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:44.435114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:44.453184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a4b44dfb-d14c-4524-bc0a-e4387637b499 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.274993 Dec 03 15:05:44.453851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 216/430] 10.222.0.63 () {60 vars in 1185 bytes} [Thu Dec 3 15:05:44 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:44.473822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8fa02ff1-4834-462a-a9b8-ff08cc8cc09e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'create', calling method: .version_select at 0x7fd5f74017b8>, body: {"security_group_rule": {"parent_group_id": "5ffdf135-388f-48b5-bce4-3a1c9059bc68", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:44.758122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8fa02ff1-4834-462a-a9b8-ff08cc8cc09e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.297090 Dec 03 15:05:44.759940 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 217/431] 10.222.0.63 () {60 vars in 1185 bytes} [Thu Dec 3 15:05:44 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:05:44.779287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:44.790735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6aa1aae5-eed1-4395-9678-dacde905958f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-35739318"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:44.794969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6aa1aae5-eed1-4395-9678-dacde905958f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:44.811604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:44.814772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6aa1aae5-eed1-4395-9678-dacde905958f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:44.815494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6aa1aae5-eed1-4395-9678-dacde905958f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:44.816625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6aa1aae5-eed1-4395-9678-dacde905958f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:44.817287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6aa1aae5-eed1-4395-9678-dacde905958f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:44.820442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:44.823682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7ee2ab28-d929-4823-9bcf-dd5b1c208369 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.413621 Dec 03 15:05:44.825021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 215/432] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:44 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:44.866226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8ea925fa-45db-4853-b950-6a97ceb7177d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:44.868075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8ea925fa-45db-4853-b950-6a97ceb7177d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:44.880349 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8ea925fa-45db-4853-b950-6a97ceb7177d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:44.880987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8ea925fa-45db-4853-b950-6a97ceb7177d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:44.882157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8ea925fa-45db-4853-b950-6a97ceb7177d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:44.882594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8ea925fa-45db-4853-b950-6a97ceb7177d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:45.119819 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.network.security_group_api [None req-6aa1aae5-eed1-4395-9678-dacde905958f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Adding security group 5ffdf135-388f-48b5-bce4-3a1c9059bc68 to port afe54511-8f8c-42eb-8ca3-b2337f457222 Dec 03 15:05:45.216397 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8ea925fa-45db-4853-b950-6a97ceb7177d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:45.225720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8ea925fa-45db-4853-b950-6a97ceb7177d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.369154 Dec 03 15:05:45.226612 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 216/433] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:44 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:45.236458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-36762313-e6aa-469e-aecb-816b6d39b98e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:45.237064 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-36762313-e6aa-469e-aecb-816b6d39b98e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:45.245526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36762313-e6aa-469e-aecb-816b6d39b98e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:45.246082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36762313-e6aa-469e-aecb-816b6d39b98e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:45.246926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36762313-e6aa-469e-aecb-816b6d39b98e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:45.247414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36762313-e6aa-469e-aecb-816b6d39b98e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:45.511168 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-36762313-e6aa-469e-aecb-816b6d39b98e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:45.519996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-36762313-e6aa-469e-aecb-816b6d39b98e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.292470 Dec 03 15:05:45.520696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 217/434] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:45 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:45.850787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:45.851447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:45.859715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:45.860268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:45.861102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:45.861589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:45.980362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6aa1aae5-eed1-4395-9678-dacde905958f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/action" status: 202 len: 0 microversion: 2.1 time: 1.212460 Dec 03 15:05:45.984327 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 218/435] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:05:44 2020] POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/action => generated 0 bytes in 1214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:05:46.003402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2678f5bd-17e1-499b-bdb0-53e6c572a10c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:46.004090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2678f5bd-17e1-499b-bdb0-53e6c572a10c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:46.013516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2678f5bd-17e1-499b-bdb0-53e6c572a10c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:46.014265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2678f5bd-17e1-499b-bdb0-53e6c572a10c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:46.015687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2678f5bd-17e1-499b-bdb0-53e6c572a10c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:46.015810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2678f5bd-17e1-499b-bdb0-53e6c572a10c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:46.181871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:46.213437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:46.220136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:46.221466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e22b6257-f30e-4660-90ba-cbe95c91fae3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.380108 Dec 03 15:05:46.222578 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 218/436] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:45 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:05:46.233129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-bc5e44a1-26b2-4cd5-ad97-9b6a9bb33fca req-cf285f35-af0c-45a3-903e-86e0c82eb0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c340b42-3ca5-4f89-8fc2-c448e784ac83", "tag": "afe54511-8f8c-42eb-8ca3-b2337f457222"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:46.240425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:05:46.240425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:05:46.251968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-bc5e44a1-26b2-4cd5-ad97-9b6a9bb33fca req-cf285f35-af0c-45a3-903e-86e0c82eb0fb service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:46.252585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-bc5e44a1-26b2-4cd5-ad97-9b6a9bb33fca req-cf285f35-af0c-45a3-903e-86e0c82eb0fb service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:46.271662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-bc5e44a1-26b2-4cd5-ad97-9b6a9bb33fca req-cf285f35-af0c-45a3-903e-86e0c82eb0fb service nova] Creating event network-changed:afe54511-8f8c-42eb-8ca3-b2337f457222 for instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 on hv-cinder-75790 Dec 03 15:05:46.278909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-bc5e44a1-26b2-4cd5-ad97-9b6a9bb33fca req-cf285f35-af0c-45a3-903e-86e0c82eb0fb service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054849 Dec 03 15:05:46.279708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 219/437] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:05:46 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:05:46.297185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6289dd82-0e8b-4f73-a04e-3e768251f883 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:46.298123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6289dd82-0e8b-4f73-a04e-3e768251f883 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:46.307486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6289dd82-0e8b-4f73-a04e-3e768251f883 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:46.308127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6289dd82-0e8b-4f73-a04e-3e768251f883 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:46.309069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6289dd82-0e8b-4f73-a04e-3e768251f883 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:46.309737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6289dd82-0e8b-4f73-a04e-3e768251f883 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:46.348146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2678f5bd-17e1-499b-bdb0-53e6c572a10c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:46.367116 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2678f5bd-17e1-499b-bdb0-53e6c572a10c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1767 microversion: 2.1 time: 0.381485 Dec 03 15:05:46.367932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 219/438] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:45 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1767 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:46.546954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9ce7adfe-0123-4234-845a-05efcbfcf335 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:46.547468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9ce7adfe-0123-4234-845a-05efcbfcf335 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:46.556587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ce7adfe-0123-4234-845a-05efcbfcf335 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:46.557099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ce7adfe-0123-4234-845a-05efcbfcf335 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:46.558012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ce7adfe-0123-4234-845a-05efcbfcf335 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:46.558512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ce7adfe-0123-4234-845a-05efcbfcf335 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:46.802535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6289dd82-0e8b-4f73-a04e-3e768251f883 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:46.816131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6289dd82-0e8b-4f73-a04e-3e768251f883 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.528767 Dec 03 15:05:46.827528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 220/439] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:46 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:46.858837 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9ce7adfe-0123-4234-845a-05efcbfcf335 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:46.867837 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9ce7adfe-0123-4234-845a-05efcbfcf335 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.332208 Dec 03 15:05:46.869242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 220/440] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:46 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:47.246896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:47.247846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:47.256157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:47.256997 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:47.258125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:47.258812 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:47.501161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:47.516007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:47.522579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:47.523778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f9f81692-5218-4d3a-b955-2c98f5574973 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.287034 Dec 03 15:05:47.524365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 221/441] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:47 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:47.841196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0e9c6eab-bbde-4ecf-a24a-1565a644c8cc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:47.841861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0e9c6eab-bbde-4ecf-a24a-1565a644c8cc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:47.849805 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e9c6eab-bbde-4ecf-a24a-1565a644c8cc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:47.850359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e9c6eab-bbde-4ecf-a24a-1565a644c8cc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:47.851195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e9c6eab-bbde-4ecf-a24a-1565a644c8cc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:47.851686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e9c6eab-bbde-4ecf-a24a-1565a644c8cc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:47.893285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-391c2953-41f3-4003-bfd5-2d58e01c5a99 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:47.894155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-391c2953-41f3-4003-bfd5-2d58e01c5a99 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:47.905200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-391c2953-41f3-4003-bfd5-2d58e01c5a99 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:47.905843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-391c2953-41f3-4003-bfd5-2d58e01c5a99 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:47.906857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-391c2953-41f3-4003-bfd5-2d58e01c5a99 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:47.907438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-391c2953-41f3-4003-bfd5-2d58e01c5a99 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:48.090583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0e9c6eab-bbde-4ecf-a24a-1565a644c8cc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:48.099598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0e9c6eab-bbde-4ecf-a24a-1565a644c8cc tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.268235 Dec 03 15:05:48.100183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 221/442] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:47 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:48.160387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-391c2953-41f3-4003-bfd5-2d58e01c5a99 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:48.170104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-391c2953-41f3-4003-bfd5-2d58e01c5a99 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.286833 Dec 03 15:05:48.170713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 222/443] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:47 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:48.548565 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:48.550065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:48.559334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:48.559846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:48.560700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:48.561200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:48.786715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:48.803320 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:48.810792 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:48.811975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5d40d0cd-dbf1-429b-85ee-36474283c4de tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.273313 Dec 03 15:05:48.812568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 222/444] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:48 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:49.122606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5672a150-79f9-431d-b31f-930c0470c1a4 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:49.123265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5672a150-79f9-431d-b31f-930c0470c1a4 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:49.131318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5672a150-79f9-431d-b31f-930c0470c1a4 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:49.131833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5672a150-79f9-431d-b31f-930c0470c1a4 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:49.132688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5672a150-79f9-431d-b31f-930c0470c1a4 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:49.133181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5672a150-79f9-431d-b31f-930c0470c1a4 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:49.205530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-dc59c0b4-2817-46d4-91fb-2be025bf5e68 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:49.206278 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-dc59c0b4-2817-46d4-91fb-2be025bf5e68 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:49.215543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dc59c0b4-2817-46d4-91fb-2be025bf5e68 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:49.216051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dc59c0b4-2817-46d4-91fb-2be025bf5e68 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:49.217045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dc59c0b4-2817-46d4-91fb-2be025bf5e68 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:49.217583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dc59c0b4-2817-46d4-91fb-2be025bf5e68 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:49.396248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5672a150-79f9-431d-b31f-930c0470c1a4 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:49.406135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5672a150-79f9-431d-b31f-930c0470c1a4 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.292729 Dec 03 15:05:49.406795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 223/445] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:49 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:49.457367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dc59c0b4-2817-46d4-91fb-2be025bf5e68 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:49.467772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-dc59c0b4-2817-46d4-91fb-2be025bf5e68 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.272987 Dec 03 15:05:49.468693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 223/446] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:49 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:49.838058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:49.838764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:49.846578 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:49.847084 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:49.847927 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:49.848413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:50.081436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:50.097571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:50.104349 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:50.105578 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f08c13e0-8f48-4c97-bea6-bb96b0a8e8a6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.277709 Dec 03 15:05:50.106197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 224/447] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:49 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:50.432163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-116815a3-a554-47ff-adeb-93ee770105f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:50.433023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-116815a3-a554-47ff-adeb-93ee770105f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:50.441408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-116815a3-a554-47ff-adeb-93ee770105f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:50.441930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-116815a3-a554-47ff-adeb-93ee770105f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:50.442880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-116815a3-a554-47ff-adeb-93ee770105f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:50.443374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-116815a3-a554-47ff-adeb-93ee770105f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:50.492016 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-38483535-9c26-4e30-9e81-376639bdb1e8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:50.492696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-38483535-9c26-4e30-9e81-376639bdb1e8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:50.503007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38483535-9c26-4e30-9e81-376639bdb1e8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:50.503529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38483535-9c26-4e30-9e81-376639bdb1e8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:50.504395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38483535-9c26-4e30-9e81-376639bdb1e8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:50.504903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38483535-9c26-4e30-9e81-376639bdb1e8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:50.695743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-116815a3-a554-47ff-adeb-93ee770105f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:50.705279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-116815a3-a554-47ff-adeb-93ee770105f6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.283480 Dec 03 15:05:50.718983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 224/448] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:50 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:50.731176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1895494500", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1271696383", "security_groups": [{"name": "tempest-TestShelveInstance-1314101855"}], "networks": [{"uuid": "0d922ba7-749c-4c5e-b6cc-12813984389c"}], "block_device_mapping_v2": [{"uuid": "a6f4fefd-cf98-4b62-89de-4b0ed8533998", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:05:50.760789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-38483535-9c26-4e30-9e81-376639bdb1e8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:50.779367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-38483535-9c26-4e30-9e81-376639bdb1e8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.296208 Dec 03 15:05:50.790040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 225/449] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:50 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:50.965830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] validate_networks() for [('0d922ba7-749c-4c5e-b6cc-12813984389c', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:05:51.130556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:51.131240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:51.141138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:51.141651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:51.142582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:51.143085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:51.391523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:51.408838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:51.416884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:51.418180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5794afbb-169c-44ed-ac02-6a40b8e38069 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.298069 Dec 03 15:05:51.418781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 226/450] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:51 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:05:51.741481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a9770baf-8d15-4675-ad27-93a3d85e6b82 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:51.742213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a9770baf-8d15-4675-ad27-93a3d85e6b82 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:51.764191 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9770baf-8d15-4675-ad27-93a3d85e6b82 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:51.765299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9770baf-8d15-4675-ad27-93a3d85e6b82 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:51.765642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9770baf-8d15-4675-ad27-93a3d85e6b82 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:51.766248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9770baf-8d15-4675-ad27-93a3d85e6b82 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:51.807018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:05:51.807954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:05:51.808667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:05:51.809297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:05:51.810042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:05:51.821346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:51.823439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:51.824531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:51.825196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:51.849012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Getting quotas for project f77c18074b76496dbbd6d15835f35760. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:05:51.854725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Getting quotas for user db41c9e650f8422f869cd588c90638a9 and project f77c18074b76496dbbd6d15835f35760. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:05:51.974154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:05:51.976547 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6f4fefd-cf98-4b62-89de-4b0ed8533998',volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:05:52.052954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a9770baf-8d15-4675-ad27-93a3d85e6b82 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:52.064194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a9770baf-8d15-4675-ad27-93a3d85e6b82 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.331760 Dec 03 15:05:52.069773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 227/451] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:51 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:52.082033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-21b108fb-0fbe-4c1c-a7d2-34f7871df21f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:52.082713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-21b108fb-0fbe-4c1c-a7d2-34f7871df21f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:52.090811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21b108fb-0fbe-4c1c-a7d2-34f7871df21f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:52.091323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21b108fb-0fbe-4c1c-a7d2-34f7871df21f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:52.092163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21b108fb-0fbe-4c1c-a7d2-34f7871df21f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:52.092657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21b108fb-0fbe-4c1c-a7d2-34f7871df21f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:52.248443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-97b10870-968a-4c0d-9ce3-85d2df83aa6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.527664 Dec 03 15:05:52.249363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 225/452] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:05:50 2020] POST /compute/v2.1/servers => generated 410 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:05:52.266336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d849ce65-9e77-4865-afc5-d026e58a29d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:52.267012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d849ce65-9e77-4865-afc5-d026e58a29d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:52.361331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d849ce65-9e77-4865-afc5-d026e58a29d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:52.371779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d849ce65-9e77-4865-afc5-d026e58a29d1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1089 microversion: 2.1 time: 0.115173 Dec 03 15:05:52.372490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 226/453] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:52 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1089 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:52.376270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-21b108fb-0fbe-4c1c-a7d2-34f7871df21f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:52.386555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-21b108fb-0fbe-4c1c-a7d2-34f7871df21f tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.315066 Dec 03 15:05:52.396908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 228/454] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:52 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:52.445258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:52.446090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:52.455322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:52.455991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:52.456877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:52.457937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:52.717285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:52.733769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:52.740792 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:52.747357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-49168129-610b-4172-b64b-f633b1963e2c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.307515 Dec 03 15:05:52.749096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 227/455] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:52 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:53.088830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-36a0db32-968f-4280-9121-e9afbb93e7f9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:53.089418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-36a0db32-968f-4280-9121-e9afbb93e7f9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:53.097330 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36a0db32-968f-4280-9121-e9afbb93e7f9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:53.097840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36a0db32-968f-4280-9121-e9afbb93e7f9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:53.098727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36a0db32-968f-4280-9121-e9afbb93e7f9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:53.099222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36a0db32-968f-4280-9121-e9afbb93e7f9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:53.323447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-36a0db32-968f-4280-9121-e9afbb93e7f9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:53.338164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-36a0db32-968f-4280-9121-e9afbb93e7f9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.258264 Dec 03 15:05:53.338999 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 229/456] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:53 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:53.395738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fea506bc-4d5d-4214-8e1b-d76cbbb0f214 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:53.396414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fea506bc-4d5d-4214-8e1b-d76cbbb0f214 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:53.410989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fea506bc-4d5d-4214-8e1b-d76cbbb0f214 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:53.411501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fea506bc-4d5d-4214-8e1b-d76cbbb0f214 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:53.412369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fea506bc-4d5d-4214-8e1b-d76cbbb0f214 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:53.412484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8b185639-2734-4102-b015-8ddc4a388c58 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:53.412877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fea506bc-4d5d-4214-8e1b-d76cbbb0f214 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:53.413133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8b185639-2734-4102-b015-8ddc4a388c58 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:53.422703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b185639-2734-4102-b015-8ddc4a388c58 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:53.423203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b185639-2734-4102-b015-8ddc4a388c58 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:53.424053 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b185639-2734-4102-b015-8ddc4a388c58 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:53.424541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b185639-2734-4102-b015-8ddc4a388c58 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:53.551528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fea506bc-4d5d-4214-8e1b-d76cbbb0f214 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:53.562457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fea506bc-4d5d-4214-8e1b-d76cbbb0f214 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1139 microversion: 2.1 time: 0.175685 Dec 03 15:05:53.563071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 228/457] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:53 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1139 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:53.658725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8b185639-2734-4102-b015-8ddc4a388c58 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:53.668844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8b185639-2734-4102-b015-8ddc4a388c58 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.267121 Dec 03 15:05:53.674100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 230/458] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:53 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:53.776435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:53.777190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:53.785426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:53.785960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:53.786828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:53.787324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:54.030594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:54.047286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:54.054010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:54.055477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4ac0205b-f4b3-4a60-8f5b-03e310220194 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.291203 Dec 03 15:05:54.056838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 229/459] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:53 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:54.372738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-515768f8-21ac-4099-b2a0-b90ed8809270 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:54.373929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-515768f8-21ac-4099-b2a0-b90ed8809270 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:54.388725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-515768f8-21ac-4099-b2a0-b90ed8809270 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:54.389557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-515768f8-21ac-4099-b2a0-b90ed8809270 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:54.390868 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-515768f8-21ac-4099-b2a0-b90ed8809270 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:54.391434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-515768f8-21ac-4099-b2a0-b90ed8809270 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:54.590414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f1eaec55-6348-457c-bfeb-ba0c6142f69a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:54.591098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f1eaec55-6348-457c-bfeb-ba0c6142f69a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:54.599263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1eaec55-6348-457c-bfeb-ba0c6142f69a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:54.599910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1eaec55-6348-457c-bfeb-ba0c6142f69a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:54.600793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1eaec55-6348-457c-bfeb-ba0c6142f69a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:54.601289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1eaec55-6348-457c-bfeb-ba0c6142f69a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:54.620696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-515768f8-21ac-4099-b2a0-b90ed8809270 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:54.632108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-515768f8-21ac-4099-b2a0-b90ed8809270 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.278253 Dec 03 15:05:54.634811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 231/460] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:54 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:54.693429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-222f26df-0f66-4b88-b61d-2ba54dc27d4a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:54.694153 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-222f26df-0f66-4b88-b61d-2ba54dc27d4a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:54.702469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-222f26df-0f66-4b88-b61d-2ba54dc27d4a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:54.702982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-222f26df-0f66-4b88-b61d-2ba54dc27d4a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:54.703837 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-222f26df-0f66-4b88-b61d-2ba54dc27d4a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:54.704334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-222f26df-0f66-4b88-b61d-2ba54dc27d4a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:54.741082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f1eaec55-6348-457c-bfeb-ba0c6142f69a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:54.758009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f1eaec55-6348-457c-bfeb-ba0c6142f69a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1139 microversion: 2.1 time: 0.179372 Dec 03 15:05:54.760404 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 230/461] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:54 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1139 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:54.949052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-222f26df-0f66-4b88-b61d-2ba54dc27d4a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:54.958395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-222f26df-0f66-4b88-b61d-2ba54dc27d4a tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.274055 Dec 03 15:05:54.958923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 232/462] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:54 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:55.081468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:55.082204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:55.090383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:55.090890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:55.091743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:55.092238 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:55.335804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:55.351149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:55.358308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:55.359830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0e89f5ec-634b-4ed7-af79-698af9119261 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.288097 Dec 03 15:05:55.364421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 231/463] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:55 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:55.656516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d0f2a578-4c57-4673-9dc9-cdf10af0f5bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:55.657185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d0f2a578-4c57-4673-9dc9-cdf10af0f5bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:55.666570 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0f2a578-4c57-4673-9dc9-cdf10af0f5bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:55.667085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0f2a578-4c57-4673-9dc9-cdf10af0f5bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:55.667944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0f2a578-4c57-4673-9dc9-cdf10af0f5bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:55.668442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0f2a578-4c57-4673-9dc9-cdf10af0f5bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:55.782961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-068f390f-8270-4c13-882b-27f56a16cc49 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:55.783639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-068f390f-8270-4c13-882b-27f56a16cc49 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:55.792443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-068f390f-8270-4c13-882b-27f56a16cc49 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:55.792953 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-068f390f-8270-4c13-882b-27f56a16cc49 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:55.793818 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-068f390f-8270-4c13-882b-27f56a16cc49 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:55.794398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-068f390f-8270-4c13-882b-27f56a16cc49 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:55.897210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d0f2a578-4c57-4673-9dc9-cdf10af0f5bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:55.906960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d0f2a578-4c57-4673-9dc9-cdf10af0f5bd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.259816 Dec 03 15:05:55.907546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 233/464] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:55 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:55.928363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-068f390f-8270-4c13-882b-27f56a16cc49 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:55.937558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-068f390f-8270-4c13-882b-27f56a16cc49 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1139 microversion: 2.1 time: 0.164865 Dec 03 15:05:55.938222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 232/465] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:55 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1139 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:55.983942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-73a19df5-ddb3-4f2a-bbe1-3a7a74fa82ef tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:55.984610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-73a19df5-ddb3-4f2a-bbe1-3a7a74fa82ef tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:55.992474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-73a19df5-ddb3-4f2a-bbe1-3a7a74fa82ef tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:55.992976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-73a19df5-ddb3-4f2a-bbe1-3a7a74fa82ef tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:55.994045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-73a19df5-ddb3-4f2a-bbe1-3a7a74fa82ef tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:55.994537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-73a19df5-ddb3-4f2a-bbe1-3a7a74fa82ef tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:56.213831 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-73a19df5-ddb3-4f2a-bbe1-3a7a74fa82ef tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:56.222712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-73a19df5-ddb3-4f2a-bbe1-3a7a74fa82ef tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.248969 Dec 03 15:05:56.223310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 234/466] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:55 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:56.386115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:56.386791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:56.395839 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:56.396348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:56.397179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:56.397667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:56.841275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:56.858160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:56.865198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:56.866529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4734ff21-6343-48fc-b248-1de67ecbca6d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.490518 Dec 03 15:05:56.867378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 233/467] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:56 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:56.933334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2eda44e3-12ba-4298-813e-e51def294e21 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:56.934076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2eda44e3-12ba-4298-813e-e51def294e21 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:56.942389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2eda44e3-12ba-4298-813e-e51def294e21 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:56.942993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2eda44e3-12ba-4298-813e-e51def294e21 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:56.943958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2eda44e3-12ba-4298-813e-e51def294e21 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:56.944543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2eda44e3-12ba-4298-813e-e51def294e21 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:56.962649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cb0e8e9f-83d7-4d2a-8313-363cdd9f0799 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:56.963748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cb0e8e9f-83d7-4d2a-8313-363cdd9f0799 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:56.972781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb0e8e9f-83d7-4d2a-8313-363cdd9f0799 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:56.973569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb0e8e9f-83d7-4d2a-8313-363cdd9f0799 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:56.974569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb0e8e9f-83d7-4d2a-8313-363cdd9f0799 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:56.975281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb0e8e9f-83d7-4d2a-8313-363cdd9f0799 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:57.145438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cb0e8e9f-83d7-4d2a-8313-363cdd9f0799 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:57.155559 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cb0e8e9f-83d7-4d2a-8313-363cdd9f0799 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1187 microversion: 2.1 time: 0.203412 Dec 03 15:05:57.156182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 234/468] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:56 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1187 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:57.248989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6ad566ac-d702-4003-9b0b-970edbe39126 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:57.249693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6ad566ac-d702-4003-9b0b-970edbe39126 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:57.267467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6ad566ac-d702-4003-9b0b-970edbe39126 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:57.268664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6ad566ac-d702-4003-9b0b-970edbe39126 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:57.270173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6ad566ac-d702-4003-9b0b-970edbe39126 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:57.271582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6ad566ac-d702-4003-9b0b-970edbe39126 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:57.354287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2eda44e3-12ba-4298-813e-e51def294e21 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:57.363281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2eda44e3-12ba-4298-813e-e51def294e21 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.440635 Dec 03 15:05:57.363859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 235/469] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:56 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:57.698749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6ad566ac-d702-4003-9b0b-970edbe39126 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:57.708831 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6ad566ac-d702-4003-9b0b-970edbe39126 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.471464 Dec 03 15:05:57.709735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 235/470] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:57 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:57.894362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:57.895000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:57.904815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:57.905368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:57.906257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:57.906904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:58.183344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2eb7472a-a511-4147-84b8-e6e967bf195f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:58.184620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2eb7472a-a511-4147-84b8-e6e967bf195f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:58.194017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2eb7472a-a511-4147-84b8-e6e967bf195f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:58.194930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2eb7472a-a511-4147-84b8-e6e967bf195f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:58.195961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2eb7472a-a511-4147-84b8-e6e967bf195f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:58.197290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2eb7472a-a511-4147-84b8-e6e967bf195f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:58.272619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:58.294094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:58.301414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:58.302720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-281794af-675e-4077-adf7-3be84faafea5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.419933 Dec 03 15:05:58.303319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 236/471] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:57 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:05:58.390243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ebf1c477-2b34-47b4-b567-2f8685bcf016 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:58.390895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ebf1c477-2b34-47b4-b567-2f8685bcf016 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:58.402463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebf1c477-2b34-47b4-b567-2f8685bcf016 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:58.402980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebf1c477-2b34-47b4-b567-2f8685bcf016 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:58.404914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebf1c477-2b34-47b4-b567-2f8685bcf016 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:58.404914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebf1c477-2b34-47b4-b567-2f8685bcf016 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:58.653229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ebf1c477-2b34-47b4-b567-2f8685bcf016 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:58.674954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2eb7472a-a511-4147-84b8-e6e967bf195f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:58.677842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ebf1c477-2b34-47b4-b567-2f8685bcf016 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.298043 Dec 03 15:05:58.678720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 237/472] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:58 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:05:58.688397 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2eb7472a-a511-4147-84b8-e6e967bf195f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1205 microversion: 2.1 time: 0.516805 Dec 03 15:05:58.689718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 236/473] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:58 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1205 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:58.734687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ff5fe1c7-1346-43fc-86f3-e39e1bbfa1e5 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:58.738459 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ff5fe1c7-1346-43fc-86f3-e39e1bbfa1e5 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:58.783660 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff5fe1c7-1346-43fc-86f3-e39e1bbfa1e5 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:58.784171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff5fe1c7-1346-43fc-86f3-e39e1bbfa1e5 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:58.785038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff5fe1c7-1346-43fc-86f3-e39e1bbfa1e5 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:58.785527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff5fe1c7-1346-43fc-86f3-e39e1bbfa1e5 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:59.328241 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:59.328921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:59.338790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:59.339304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:59.340165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:59.340662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:59.489227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ff5fe1c7-1346-43fc-86f3-e39e1bbfa1e5 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:59.501626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ff5fe1c7-1346-43fc-86f3-e39e1bbfa1e5 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.776958 Dec 03 15:05:59.502480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 238/474] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:58 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:05:59.702682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4539a1bb-4a89-4019-aecb-8874287401dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:59.703249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4539a1bb-4a89-4019-aecb-8874287401dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:59.713114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4539a1bb-4a89-4019-aecb-8874287401dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:59.713626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4539a1bb-4a89-4019-aecb-8874287401dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:59.714521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4539a1bb-4a89-4019-aecb-8874287401dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:59.715023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4539a1bb-4a89-4019-aecb-8874287401dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:59.756133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:59.786421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:59.797126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:05:59.803476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eda46fe6-a8ff-47cc-a78e-c19c9f0d82b0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.484219 Dec 03 15:05:59.810572 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 237/475] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:05:59 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:05:59.836096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6c714f6e-8ea8-4662-95b8-1336da1a799d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:05:59.838194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6c714f6e-8ea8-4662-95b8-1336da1a799d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:05:59.844939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c714f6e-8ea8-4662-95b8-1336da1a799d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:59.845450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c714f6e-8ea8-4662-95b8-1336da1a799d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:05:59.846323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c714f6e-8ea8-4662-95b8-1336da1a799d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:05:59.846810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c714f6e-8ea8-4662-95b8-1336da1a799d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:00.225222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4539a1bb-4a89-4019-aecb-8874287401dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:00.235898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4539a1bb-4a89-4019-aecb-8874287401dd tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 200 len: 1508 microversion: 2.1 time: 0.543000 Dec 03 15:06:00.236522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 239/476] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:59 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 1508 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:00.249025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-d597666e-f561-4d50-ae8b-7117a47d8920 req-f82781fd-5c6f-4f0a-8af0-060f534f5fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7b86d5-7e34-4b4e-9561-8540a0f0fa76", "name": "network-vif-deleted", "tag": "933ad543-585e-4a97-b615-70b5dc2690fb"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:00.256630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:00.256630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:00.267901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d597666e-f561-4d50-ae8b-7117a47d8920 req-f82781fd-5c6f-4f0a-8af0-060f534f5fe1 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:00.268408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d597666e-f561-4d50-ae8b-7117a47d8920 req-f82781fd-5c6f-4f0a-8af0-060f534f5fe1 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:00.287799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-d597666e-f561-4d50-ae8b-7117a47d8920 req-f82781fd-5c6f-4f0a-8af0-060f534f5fe1 service nova] Creating event network-vif-deleted:933ad543-585e-4a97-b615-70b5dc2690fb for instance 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 on hv-cinder-75790 Dec 03 15:06:00.293874 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-d597666e-f561-4d50-ae8b-7117a47d8920 req-f82781fd-5c6f-4f0a-8af0-060f534f5fe1 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055682 Dec 03 15:06:00.294689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 240/477] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:00 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:00.375001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6c714f6e-8ea8-4662-95b8-1336da1a799d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:00.384861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6c714f6e-8ea8-4662-95b8-1336da1a799d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.572750 Dec 03 15:06:00.385709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 238/478] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:05:59 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:00.527759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bbbad78f-550c-459e-9df7-c8f24633550b tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:00.528532 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bbbad78f-550c-459e-9df7-c8f24633550b tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:00.536560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bbbad78f-550c-459e-9df7-c8f24633550b tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:00.537067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bbbad78f-550c-459e-9df7-c8f24633550b tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:00.537940 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bbbad78f-550c-459e-9df7-c8f24633550b tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:00.538420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bbbad78f-550c-459e-9df7-c8f24633550b tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:00.777799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bbbad78f-550c-459e-9df7-c8f24633550b tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:00.788763 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bbbad78f-550c-459e-9df7-c8f24633550b tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.271460 Dec 03 15:06:00.799561 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 241/479] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:00 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:00.837260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:00.838266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:00.849004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:00.849706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:00.850613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:00.851110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.260542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:01.261218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:01.269441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.269958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.270779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.271450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.314250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:01.327120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] HTTP exception thrown: Instance 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 could not be found. Dec 03 15:06:01.327789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Returning 404 to user: Instance 8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:06:01.328690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8893ab4c-5bea-460f-b2c1-5197b4f0708c tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76" status: 404 len: 111 microversion: 2.1 time: 0.078115 Dec 03 15:06:01.329493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 242/480] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:01 2020] GET /compute/v2.1/servers/8a7b86d5-7e34-4b4e-9561-8540a0f0fa76 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 15:06:01.331021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:01.338548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:01.339933 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f74f1f09-a4f4-4897-9b99-0f3d82a6b0b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.514682 Dec 03 15:06:01.340696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 239/481] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:00 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:06:01.342879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-8e34d0e5-b516-4d08-a232-2466906ec1ad req-47d086c1-6886-4fd7-b3c3-3031e502c0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add146c2-e4cc-491e-b5f9-17673e4a0c89", "tag": "f82f881d-f8f0-478d-baa4-3c020c077e99"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:01.349638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:01.349638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:01.351061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-48be3034-b66d-4485-b992-0dba2b6db2c6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:01.351776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-48be3034-b66d-4485-b992-0dba2b6db2c6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:01.359543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-8e34d0e5-b516-4d08-a232-2466906ec1ad req-47d086c1-6886-4fd7-b3c3-3031e502c0cb service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.359943 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-8e34d0e5-b516-4d08-a232-2466906ec1ad req-47d086c1-6886-4fd7-b3c3-3031e502c0cb service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.361762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48be3034-b66d-4485-b992-0dba2b6db2c6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.362331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48be3034-b66d-4485-b992-0dba2b6db2c6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.363179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48be3034-b66d-4485-b992-0dba2b6db2c6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.363644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48be3034-b66d-4485-b992-0dba2b6db2c6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.379928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-8e34d0e5-b516-4d08-a232-2466906ec1ad req-47d086c1-6886-4fd7-b3c3-3031e502c0cb service nova] Creating event network-changed:f82f881d-f8f0-478d-baa4-3c020c077e99 for instance add146c2-e4cc-491e-b5f9-17673e4a0c89 on hv-cinder-75790 Dec 03 15:06:01.385749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-8e34d0e5-b516-4d08-a232-2466906ec1ad req-47d086c1-6886-4fd7-b3c3-3031e502c0cb service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051827 Dec 03 15:06:01.386519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 243/482] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:01 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:01.409274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-28dadafc-d3ee-4b1d-9551-43e6e590de5e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:01.410090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-28dadafc-d3ee-4b1d-9551-43e6e590de5e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:01.428720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-28dadafc-d3ee-4b1d-9551-43e6e590de5e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.429552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-28dadafc-d3ee-4b1d-9551-43e6e590de5e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.432735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-28dadafc-d3ee-4b1d-9551-43e6e590de5e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.433654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-28dadafc-d3ee-4b1d-9551-43e6e590de5e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.446281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-48be3034-b66d-4485-b992-0dba2b6db2c6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:06:01.579833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-48be3034-b66d-4485-b992-0dba2b6db2c6 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "DELETE /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 204 len: 0 microversion: 2.1 time: 0.237531 Dec 03 15:06:01.580487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 240/483] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:06:01 2020] DELETE /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:06:01.599871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-56106b49-9f08-43eb-9da6-acae1d824d4a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:01.600677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-56106b49-9f08-43eb-9da6-acae1d824d4a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:01.611275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-56106b49-9f08-43eb-9da6-acae1d824d4a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.611860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-56106b49-9f08-43eb-9da6-acae1d824d4a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.613220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-56106b49-9f08-43eb-9da6-acae1d824d4a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.613709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-56106b49-9f08-43eb-9da6-acae1d824d4a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.714325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-28dadafc-d3ee-4b1d-9551-43e6e590de5e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:01.725012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-28dadafc-d3ee-4b1d-9551-43e6e590de5e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.325835 Dec 03 15:06:01.736885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 244/484] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:01 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:01.813623 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8a113c63-e070-4080-b688-49d953fad5ee tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:01.814684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8a113c63-e070-4080-b688-49d953fad5ee tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:01.824104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8a113c63-e070-4080-b688-49d953fad5ee tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.824717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8a113c63-e070-4080-b688-49d953fad5ee tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.825661 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8a113c63-e070-4080-b688-49d953fad5ee tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.826285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8a113c63-e070-4080-b688-49d953fad5ee tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:01.943421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-56106b49-9f08-43eb-9da6-acae1d824d4a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:01.953088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-56106b49-9f08-43eb-9da6-acae1d824d4a tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.366713 Dec 03 15:06:01.953721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 241/485] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:01 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:01.969542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-922a4b73-c25c-4011-8dbb-7e4d481942c3 req-55904c3f-f2e5-42c0-9142-416bde3a2ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336d98ca-1548-4d14-87f5-274050e7a048", "name": "network-vif-plugged", "status": "completed", "tag": "39d702b9-440e-4c01-93b9-46950f0484b3"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:01.979437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:01.979437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:01.989345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-922a4b73-c25c-4011-8dbb-7e4d481942c3 req-55904c3f-f2e5-42c0-9142-416bde3a2ad0 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:01.989849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-922a4b73-c25c-4011-8dbb-7e4d481942c3 req-55904c3f-f2e5-42c0-9142-416bde3a2ad0 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:02.012001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-922a4b73-c25c-4011-8dbb-7e4d481942c3 req-55904c3f-f2e5-42c0-9142-416bde3a2ad0 service nova] Creating event network-vif-plugged:39d702b9-440e-4c01-93b9-46950f0484b3 for instance 336d98ca-1548-4d14-87f5-274050e7a048 on hv-cinder-75790 Dec 03 15:06:02.017222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-922a4b73-c25c-4011-8dbb-7e4d481942c3 req-55904c3f-f2e5-42c0-9142-416bde3a2ad0 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057974 Dec 03 15:06:02.017955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 242/486] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:01 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:02.056963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8a113c63-e070-4080-b688-49d953fad5ee tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:02.066754 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8a113c63-e070-4080-b688-49d953fad5ee tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.263913 Dec 03 15:06:02.073189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 245/487] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:01 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:02.367172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:02.367951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:02.376756 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:02.377270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:02.378159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:02.378658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:02.614048 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:02.629684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:02.637051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:02.638272 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3fd1fb49-7709-4e33-a156-65109b3c9dbf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.280945 Dec 03 15:06:02.638859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 243/488] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:02 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:06:02.749169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d49b99ee-208c-417f-8a51-3f504a477dca tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:02.750014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d49b99ee-208c-417f-8a51-3f504a477dca tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:02.758282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d49b99ee-208c-417f-8a51-3f504a477dca tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:02.759548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d49b99ee-208c-417f-8a51-3f504a477dca tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:02.760908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d49b99ee-208c-417f-8a51-3f504a477dca tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:02.761657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d49b99ee-208c-417f-8a51-3f504a477dca tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:02.977015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1f0021d6-e256-44f7-8182-2bc115973cf0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:02.977846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1f0021d6-e256-44f7-8182-2bc115973cf0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:02.985882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f0021d6-e256-44f7-8182-2bc115973cf0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:02.986486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f0021d6-e256-44f7-8182-2bc115973cf0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:02.987347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f0021d6-e256-44f7-8182-2bc115973cf0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:02.987845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f0021d6-e256-44f7-8182-2bc115973cf0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:02.992418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d49b99ee-208c-417f-8a51-3f504a477dca tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:03.002401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d49b99ee-208c-417f-8a51-3f504a477dca tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.263156 Dec 03 15:06:03.015569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 246/489] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:02 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:03.091274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5dc26eaa-e2eb-43d4-ae46-424f3b594985 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:03.092076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5dc26eaa-e2eb-43d4-ae46-424f3b594985 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:03.100300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5dc26eaa-e2eb-43d4-ae46-424f3b594985 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:03.100806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5dc26eaa-e2eb-43d4-ae46-424f3b594985 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:03.101664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5dc26eaa-e2eb-43d4-ae46-424f3b594985 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:03.102182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5dc26eaa-e2eb-43d4-ae46-424f3b594985 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:03.327658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5dc26eaa-e2eb-43d4-ae46-424f3b594985 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:03.336536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5dc26eaa-e2eb-43d4-ae46-424f3b594985 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1312 microversion: 2.1 time: 0.255602 Dec 03 15:06:03.337769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 247/490] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:03 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:03.378002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1f0021d6-e256-44f7-8182-2bc115973cf0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:03.386919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1f0021d6-e256-44f7-8182-2bc115973cf0 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.419124 Dec 03 15:06:03.387525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 244/491] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:02 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:03.662491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:03.663166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:03.672122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:03.672633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:03.673486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:03.674008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:03.907657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:03.923086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:03.929632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:03.931749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3210277a-6b68-445a-8200-08ac565fac6a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.278697 Dec 03 15:06:03.932338 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 248/492] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:03 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:06:04.030255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fd4d1a8a-a961-46d5-9e69-4c8260cba44f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:04.030932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fd4d1a8a-a961-46d5-9e69-4c8260cba44f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:04.039442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd4d1a8a-a961-46d5-9e69-4c8260cba44f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:04.040044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd4d1a8a-a961-46d5-9e69-4c8260cba44f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:04.041617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd4d1a8a-a961-46d5-9e69-4c8260cba44f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:04.042140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd4d1a8a-a961-46d5-9e69-4c8260cba44f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:04.267324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fd4d1a8a-a961-46d5-9e69-4c8260cba44f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:04.276761 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fd4d1a8a-a961-46d5-9e69-4c8260cba44f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.257333 Dec 03 15:06:04.277357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 245/493] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:04 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:04.360016 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ed046067-0efe-4a84-ab86-5732971ac4f1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:04.360675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ed046067-0efe-4a84-ab86-5732971ac4f1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:04.369275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed046067-0efe-4a84-ab86-5732971ac4f1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:04.369777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed046067-0efe-4a84-ab86-5732971ac4f1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:04.370655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed046067-0efe-4a84-ab86-5732971ac4f1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:04.371147 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed046067-0efe-4a84-ab86-5732971ac4f1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:04.411090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-12573a3d-8b1a-4910-a7b3-ccfc855c9d5e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:04.411814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-12573a3d-8b1a-4910-a7b3-ccfc855c9d5e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:04.420014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-12573a3d-8b1a-4910-a7b3-ccfc855c9d5e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:04.420522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-12573a3d-8b1a-4910-a7b3-ccfc855c9d5e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:04.421366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-12573a3d-8b1a-4910-a7b3-ccfc855c9d5e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:04.421860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-12573a3d-8b1a-4910-a7b3-ccfc855c9d5e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:04.591353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ed046067-0efe-4a84-ab86-5732971ac4f1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:04.600343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ed046067-0efe-4a84-ab86-5732971ac4f1 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1495 microversion: 2.1 time: 0.249667 Dec 03 15:06:04.600954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 249/494] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:04 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1495 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:04.642930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-12573a3d-8b1a-4910-a7b3-ccfc855c9d5e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:04.652540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-12573a3d-8b1a-4910-a7b3-ccfc855c9d5e tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.252134 Dec 03 15:06:04.653146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 246/495] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:04 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:04.956560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:04.957247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:04.965830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:04.966343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:04.967192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:04.967667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.200905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:05.216495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:05.223070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:05.224266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-edacc9de-e9d3-4449-93cf-b9e59b643e42 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.276859 Dec 03 15:06:05.224855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 250/496] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:04 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:06:05.299655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fc419706-52c1-488f-af05-fe3d2a3c8efc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:05.300318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fc419706-52c1-488f-af05-fe3d2a3c8efc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:05.308815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc419706-52c1-488f-af05-fe3d2a3c8efc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:05.309322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc419706-52c1-488f-af05-fe3d2a3c8efc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.310184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc419706-52c1-488f-af05-fe3d2a3c8efc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:05.310674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc419706-52c1-488f-af05-fe3d2a3c8efc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.533526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fc419706-52c1-488f-af05-fe3d2a3c8efc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:05.543066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fc419706-52c1-488f-af05-fe3d2a3c8efc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.252485 Dec 03 15:06:05.543675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 247/497] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:05 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:05.604346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-52bda65f-a9af-4950-890e-b5c33186d133 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:05.604895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-52bda65f-a9af-4950-890e-b5c33186d133 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:05.612844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-52bda65f-a9af-4950-890e-b5c33186d133 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:05.613353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-52bda65f-a9af-4950-890e-b5c33186d133 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.614214 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-52bda65f-a9af-4950-890e-b5c33186d133 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:05.614708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-52bda65f-a9af-4950-890e-b5c33186d133 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.676602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9b1f6743-e0be-4e54-a78a-d07bf100188d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:05.677202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9b1f6743-e0be-4e54-a78a-d07bf100188d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:05.686382 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-52bda65f-a9af-4950-890e-b5c33186d133 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:06:05.686537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b1f6743-e0be-4e54-a78a-d07bf100188d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:05.686891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b1f6743-e0be-4e54-a78a-d07bf100188d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.687750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b1f6743-e0be-4e54-a78a-d07bf100188d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:05.688355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b1f6743-e0be-4e54-a78a-d07bf100188d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.811684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-52bda65f-a9af-4950-890e-b5c33186d133 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "DELETE /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 204 len: 0 microversion: 2.1 time: 0.216748 Dec 03 15:06:05.812515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 251/498] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:06:05 2020] DELETE /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:06:05.830060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a4bdd746-b864-41c0-b61d-f0f9cedad9ca tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:05.830850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a4bdd746-b864-41c0-b61d-f0f9cedad9ca tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:05.840185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a4bdd746-b864-41c0-b61d-f0f9cedad9ca tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:05.840695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a4bdd746-b864-41c0-b61d-f0f9cedad9ca tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.841567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a4bdd746-b864-41c0-b61d-f0f9cedad9ca tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:05.842105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a4bdd746-b864-41c0-b61d-f0f9cedad9ca tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:05.924317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9b1f6743-e0be-4e54-a78a-d07bf100188d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:05.934928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9b1f6743-e0be-4e54-a78a-d07bf100188d tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.267345 Dec 03 15:06:05.935474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 248/499] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:05 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:06.216765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a4bdd746-b864-41c0-b61d-f0f9cedad9ca tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:06.225617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a4bdd746-b864-41c0-b61d-f0f9cedad9ca tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1501 microversion: 2.1 time: 0.408623 Dec 03 15:06:06.226302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 252/500] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:05 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1501 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:06.250957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:06.251630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:06.260682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:06.261197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:06.262082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:06.262588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:06.491057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:06.507191 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:06.514921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:06.516126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2b49bfdd-c4fe-4aba-a78f-cc4032d37ae2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.275756 Dec 03 15:06:06.516717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 249/501] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:06 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:06:06.566627 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-101e7571-bc8e-45d2-a144-1cd2521cd7ae tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:06.567308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-101e7571-bc8e-45d2-a144-1cd2521cd7ae tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:06.575942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-101e7571-bc8e-45d2-a144-1cd2521cd7ae tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:06.576454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-101e7571-bc8e-45d2-a144-1cd2521cd7ae tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:06.577300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-101e7571-bc8e-45d2-a144-1cd2521cd7ae tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:06.577822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-101e7571-bc8e-45d2-a144-1cd2521cd7ae tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:06.796556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-101e7571-bc8e-45d2-a144-1cd2521cd7ae tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:06.806480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-101e7571-bc8e-45d2-a144-1cd2521cd7ae tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.248158 Dec 03 15:06:06.807085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 253/502] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:06 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:06.958646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-453d43ce-ccde-46f2-9b8f-cf6b79493f36 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:06.959319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-453d43ce-ccde-46f2-9b8f-cf6b79493f36 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:06.967982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-453d43ce-ccde-46f2-9b8f-cf6b79493f36 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:06.968495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-453d43ce-ccde-46f2-9b8f-cf6b79493f36 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:06.969333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-453d43ce-ccde-46f2-9b8f-cf6b79493f36 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:06.969825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-453d43ce-ccde-46f2-9b8f-cf6b79493f36 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:07.190133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-453d43ce-ccde-46f2-9b8f-cf6b79493f36 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:07.200315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-453d43ce-ccde-46f2-9b8f-cf6b79493f36 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.250718 Dec 03 15:06:07.200921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 250/503] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:06 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:07.249746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3fdd87a7-d41c-4555-a504-80aa9a9d43a8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:07.250444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3fdd87a7-d41c-4555-a504-80aa9a9d43a8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:07.258297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fdd87a7-d41c-4555-a504-80aa9a9d43a8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:07.259502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fdd87a7-d41c-4555-a504-80aa9a9d43a8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:07.260527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fdd87a7-d41c-4555-a504-80aa9a9d43a8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:07.261024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fdd87a7-d41c-4555-a504-80aa9a9d43a8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:07.483259 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3fdd87a7-d41c-4555-a504-80aa9a9d43a8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:07.492113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3fdd87a7-d41c-4555-a504-80aa9a9d43a8 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1501 microversion: 2.1 time: 0.252007 Dec 03 15:06:07.492712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 254/504] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:07 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:07.540566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:07.541246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:07.549164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:07.549698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:07.550548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:07.551244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:07.773472 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:07.789203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:07.790828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-ce7f5741-abd3-47de-aefc-1cf7f352cc8f req-192fed81-f12b-43d8-af1e-bf94edc1996c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53f7d53-2ae6-4edd-84c2-09e523498d7d", "name": "network-vif-plugged", "status": "completed", "tag": "6e8050ed-0789-4bcc-bbe2-11f953a2e2ed"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:07.795976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:07.797226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5623f790-c6aa-40e2-8763-8b714394fffd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.265873 Dec 03 15:06:07.797943 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 251/505] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:07 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:06:07.801456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:07.801456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:07.812503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ce7f5741-abd3-47de-aefc-1cf7f352cc8f req-192fed81-f12b-43d8-af1e-bf94edc1996c service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:07.813092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ce7f5741-abd3-47de-aefc-1cf7f352cc8f req-192fed81-f12b-43d8-af1e-bf94edc1996c service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:07.831602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d7b56ebc-7025-4eea-b271-a876da793849 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:07.833013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d7b56ebc-7025-4eea-b271-a876da793849 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:07.833142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-ce7f5741-abd3-47de-aefc-1cf7f352cc8f req-192fed81-f12b-43d8-af1e-bf94edc1996c service nova] Creating event network-vif-plugged:6e8050ed-0789-4bcc-bbe2-11f953a2e2ed for instance f53f7d53-2ae6-4edd-84c2-09e523498d7d on hv-cinder-75790 Dec 03 15:06:07.838276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-ce7f5741-abd3-47de-aefc-1cf7f352cc8f req-192fed81-f12b-43d8-af1e-bf94edc1996c service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060228 Dec 03 15:06:07.838944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 255/506] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:07 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:06:07.841094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d7b56ebc-7025-4eea-b271-a876da793849 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:07.841601 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d7b56ebc-7025-4eea-b271-a876da793849 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:07.842632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d7b56ebc-7025-4eea-b271-a876da793849 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:07.843287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d7b56ebc-7025-4eea-b271-a876da793849 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:08.069660 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d7b56ebc-7025-4eea-b271-a876da793849 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:08.080242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d7b56ebc-7025-4eea-b271-a876da793849 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.258621 Dec 03 15:06:08.080863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 252/507] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:07 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:08.224735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d821bbc2-8a7f-4f8a-8d91-6df5b23f7910 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:08.225513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d821bbc2-8a7f-4f8a-8d91-6df5b23f7910 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:08.234275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d821bbc2-8a7f-4f8a-8d91-6df5b23f7910 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:08.234794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d821bbc2-8a7f-4f8a-8d91-6df5b23f7910 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:08.235829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d821bbc2-8a7f-4f8a-8d91-6df5b23f7910 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:08.236351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d821bbc2-8a7f-4f8a-8d91-6df5b23f7910 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:08.478247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d821bbc2-8a7f-4f8a-8d91-6df5b23f7910 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:08.487520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d821bbc2-8a7f-4f8a-8d91-6df5b23f7910 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.272878 Dec 03 15:06:08.488331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 256/508] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:08 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:08.517342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-df6e6fc3-759e-4828-9da4-277b6d085394 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:08.518042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-df6e6fc3-759e-4828-9da4-277b6d085394 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:08.526187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df6e6fc3-759e-4828-9da4-277b6d085394 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:08.528523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df6e6fc3-759e-4828-9da4-277b6d085394 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:08.529457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df6e6fc3-759e-4828-9da4-277b6d085394 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:08.530132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df6e6fc3-759e-4828-9da4-277b6d085394 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:08.824234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:08.825021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:08.833635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:08.834186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:08.835042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:08.835815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:09.078644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-df6e6fc3-759e-4828-9da4-277b6d085394 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:09.084117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:09.091028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-df6e6fc3-759e-4828-9da4-277b6d085394 tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1501 microversion: 2.1 time: 0.583691 Dec 03 15:06:09.092220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 253/509] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:08 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1501 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:09.103901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:09.105983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1c305bf3-39aa-4333-b3a7-48b66a3ba3c4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:09.106841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1c305bf3-39aa-4333-b3a7-48b66a3ba3c4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:09.112885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:09.114296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-54ca79cd-5a8b-41d8-9cbb-631953287596 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.301385 Dec 03 15:06:09.115521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 257/510] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:08 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:06:09.116939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c305bf3-39aa-4333-b3a7-48b66a3ba3c4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:09.118298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c305bf3-39aa-4333-b3a7-48b66a3ba3c4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:09.119732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c305bf3-39aa-4333-b3a7-48b66a3ba3c4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:09.121061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c305bf3-39aa-4333-b3a7-48b66a3ba3c4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:09.511637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fe0e8979-dd8d-4423-bb90-57b054adc34f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:09.512308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fe0e8979-dd8d-4423-bb90-57b054adc34f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:09.520314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe0e8979-dd8d-4423-bb90-57b054adc34f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:09.520821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe0e8979-dd8d-4423-bb90-57b054adc34f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:09.521654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe0e8979-dd8d-4423-bb90-57b054adc34f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:09.522175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe0e8979-dd8d-4423-bb90-57b054adc34f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:09.718299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1c305bf3-39aa-4333-b3a7-48b66a3ba3c4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:09.728594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1c305bf3-39aa-4333-b3a7-48b66a3ba3c4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.632667 Dec 03 15:06:09.738379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 254/511] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:09 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:09.739233 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-ef0b9423-047a-4d09-9bcc-b02ccac58a1a req-d081343b-a0ce-49f3-922b-948592730e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336d98ca-1548-4d14-87f5-274050e7a048", "name": "network-vif-deleted", "tag": "39d702b9-440e-4c01-93b9-46950f0484b3"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:09.750072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:09.750072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:09.752037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fe0e8979-dd8d-4423-bb90-57b054adc34f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:09.759382 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ef0b9423-047a-4d09-9bcc-b02ccac58a1a req-d081343b-a0ce-49f3-922b-948592730e01 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:09.759887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ef0b9423-047a-4d09-9bcc-b02ccac58a1a req-d081343b-a0ce-49f3-922b-948592730e01 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:09.762102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fe0e8979-dd8d-4423-bb90-57b054adc34f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.259686 Dec 03 15:06:09.763186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 258/512] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:09 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:09.782795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-ef0b9423-047a-4d09-9bcc-b02ccac58a1a req-d081343b-a0ce-49f3-922b-948592730e01 service nova] Creating event network-vif-deleted:39d702b9-440e-4c01-93b9-46950f0484b3 for instance 336d98ca-1548-4d14-87f5-274050e7a048 on hv-cinder-75790 Dec 03 15:06:09.788029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-ef0b9423-047a-4d09-9bcc-b02ccac58a1a req-d081343b-a0ce-49f3-922b-948592730e01 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057636 Dec 03 15:06:09.789057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 255/513] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:09 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:10.115205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:10.115876 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:10.123974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.124484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.125326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.125824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.140377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:10.141146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:10.152822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.153332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.154242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.154737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.205749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.206322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.206834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lazy-loading 'fault' on Instance uuid 336d98ca-1548-4d14-87f5-274050e7a048 {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:06:10.300838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d0d7452254183ba3531b7c01a830b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ba93ac65044e99ad68789f769dd71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:10.311970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3d554b12-4d1a-4aa3-be06-b22e5d3a763e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 200 len: 1302 microversion: 2.1 time: 0.205938 Dec 03 15:06:10.312672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 259/514] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:10 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:10.385466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:10.402620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:10.409222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:10.410503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cfa416ba-d85e-4378-a3ff-992e3e7f16c7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1807 microversion: 2.20 time: 0.279965 Dec 03 15:06:10.411155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 256/515] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:10 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:06:10.752227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a9effd00-e819-451d-8593-ea4fec91cca1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:10.753565 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a9effd00-e819-451d-8593-ea4fec91cca1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:10.762968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9effd00-e819-451d-8593-ea4fec91cca1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.763722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9effd00-e819-451d-8593-ea4fec91cca1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.764778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9effd00-e819-451d-8593-ea4fec91cca1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.765471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a9effd00-e819-451d-8593-ea4fec91cca1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.786428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-54de2b17-b49b-4f37-bf0d-a26c68e525c9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:10.787623 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-54de2b17-b49b-4f37-bf0d-a26c68e525c9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:10.797727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54de2b17-b49b-4f37-bf0d-a26c68e525c9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.798282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54de2b17-b49b-4f37-bf0d-a26c68e525c9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.799109 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54de2b17-b49b-4f37-bf0d-a26c68e525c9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:10.799866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54de2b17-b49b-4f37-bf0d-a26c68e525c9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:10.990090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a9effd00-e819-451d-8593-ea4fec91cca1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:11.004025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a9effd00-e819-451d-8593-ea4fec91cca1 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.261610 Dec 03 15:06:11.004615 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 260/516] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:10 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:11.049644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-54de2b17-b49b-4f37-bf0d-a26c68e525c9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:11.061423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e1017e1b-384b-426a-b348-36b13f91ecbc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:11.062331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e1017e1b-384b-426a-b348-36b13f91ecbc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:11.062445 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-54de2b17-b49b-4f37-bf0d-a26c68e525c9 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.286136 Dec 03 15:06:11.063065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 257/517] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:10 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:11.078785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1017e1b-384b-426a-b348-36b13f91ecbc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:11.079497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1017e1b-384b-426a-b348-36b13f91ecbc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:11.080563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1017e1b-384b-426a-b348-36b13f91ecbc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:11.081150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1017e1b-384b-426a-b348-36b13f91ecbc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:11.335883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:11.336556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] [instance: 336d98ca-1548-4d14-87f5-274050e7a048] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:11.345541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:11.346086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:11.346954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:11.347437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:11.406502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e1017e1b-384b-426a-b348-36b13f91ecbc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/os-volume_attachments/87626393-f38f-4fcc-9bec-911d1f19ec0c" status: 202 len: 0 microversion: 2.1 time: 0.356270 Dec 03 15:06:11.407388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 261/518] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:06:11 2020] DELETE /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/os-volume_attachments/87626393-f38f-4fcc-9bec-911d1f19ec0c => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:06:11.408814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] HTTP exception thrown: Instance 336d98ca-1548-4d14-87f5-274050e7a048 could not be found. Dec 03 15:06:11.409616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] Returning 404 to user: Instance 336d98ca-1548-4d14-87f5-274050e7a048 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:06:11.410776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f40b1b60-d190-40a8-ad7a-a526003c693e tempest-VolumesActionsTest-2138202625 tempest-VolumesActionsTest-2138202625] 10.222.0.63 "GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048" status: 404 len: 111 microversion: 2.1 time: 0.084068 Dec 03 15:06:11.411395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 258/519] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:11 2020] GET /compute/v2.1/servers/336d98ca-1548-4d14-87f5-274050e7a048 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 15:06:11.441114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:11.442347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:11.452753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:11.453263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:11.454163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:11.454783 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:11.741464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:11.759869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:11.767825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:11.769407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-76e1c76b-8656-4f86-a386-9e753cdaecce tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1794 microversion: 2.20 time: 0.341662 Dec 03 15:06:11.770189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 262/520] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:06:11 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1794 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:06:12.036241 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-25618e51-6498-488d-a4e4-c47ed1c5220d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:12.037263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-25618e51-6498-488d-a4e4-c47ed1c5220d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:12.046297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-25618e51-6498-488d-a4e4-c47ed1c5220d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:12.047824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-25618e51-6498-488d-a4e4-c47ed1c5220d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:12.048872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-25618e51-6498-488d-a4e4-c47ed1c5220d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:12.049536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-25618e51-6498-488d-a4e4-c47ed1c5220d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:12.116006 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2e3ebadd-80b6-4de3-be5c-2a8e94437a34 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:12.116703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2e3ebadd-80b6-4de3-be5c-2a8e94437a34 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:12.127242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e3ebadd-80b6-4de3-be5c-2a8e94437a34 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:12.128094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e3ebadd-80b6-4de3-be5c-2a8e94437a34 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:12.129346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e3ebadd-80b6-4de3-be5c-2a8e94437a34 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:12.129852 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e3ebadd-80b6-4de3-be5c-2a8e94437a34 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:12.473803 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2e3ebadd-80b6-4de3-be5c-2a8e94437a34 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:12.502570 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2e3ebadd-80b6-4de3-be5c-2a8e94437a34 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1522 microversion: 2.1 time: 0.417694 Dec 03 15:06:12.508738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 263/521] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:12 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:12.668915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-c8ef1094-623a-43ab-8709-5cb6df10b375 req-d92eb623-e82e-4e97-bce5-e490090d8147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add146c2-e4cc-491e-b5f9-17673e4a0c89", "name": "network-vif-plugged", "status": "completed", "tag": "f82f881d-f8f0-478d-baa4-3c020c077e99"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:12.676049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:12.676049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:12.686437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-c8ef1094-623a-43ab-8709-5cb6df10b375 req-d92eb623-e82e-4e97-bce5-e490090d8147 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:12.686923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-c8ef1094-623a-43ab-8709-5cb6df10b375 req-d92eb623-e82e-4e97-bce5-e490090d8147 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:12.706138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-c8ef1094-623a-43ab-8709-5cb6df10b375 req-d92eb623-e82e-4e97-bce5-e490090d8147 service nova] Creating event network-vif-plugged:f82f881d-f8f0-478d-baa4-3c020c077e99 for instance add146c2-e4cc-491e-b5f9-17673e4a0c89 on hv-cinder-75790 Dec 03 15:06:12.712076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-c8ef1094-623a-43ab-8709-5cb6df10b375 req-d92eb623-e82e-4e97-bce5-e490090d8147 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052720 Dec 03 15:06:12.713282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 264/522] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:12 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:06:12.715451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-25618e51-6498-488d-a4e4-c47ed1c5220d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:12.726268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-25618e51-6498-488d-a4e4-c47ed1c5220d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.699820 Dec 03 15:06:12.738475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 259/523] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:12 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:13.043096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-63fe4a54-eb69-4222-bda9-e10ef8d0837d req-2d09b2db-99bd-4a1b-8e61-2d042c4a1881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c233978f-9c32-47bf-8b66-44f0baa08830", "name": "network-vif-deleted", "tag": "4fcc7ba2-ca25-407b-8386-4f72181d346e"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:13.049789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:13.049789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:13.062395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-63fe4a54-eb69-4222-bda9-e10ef8d0837d req-2d09b2db-99bd-4a1b-8e61-2d042c4a1881 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:13.062817 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-63fe4a54-eb69-4222-bda9-e10ef8d0837d req-2d09b2db-99bd-4a1b-8e61-2d042c4a1881 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:13.085804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-63fe4a54-eb69-4222-bda9-e10ef8d0837d req-2d09b2db-99bd-4a1b-8e61-2d042c4a1881 service nova] Creating event network-vif-deleted:4fcc7ba2-ca25-407b-8386-4f72181d346e for instance c233978f-9c32-47bf-8b66-44f0baa08830 on hv-cinder-75790 Dec 03 15:06:13.092402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-63fe4a54-eb69-4222-bda9-e10ef8d0837d req-2d09b2db-99bd-4a1b-8e61-2d042c4a1881 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072329 Dec 03 15:06:13.093230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 265/524] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:13 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:13.529762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:13.530541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:13.539800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:13.540327 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:13.541639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:13.542163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:13.626181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:13.626566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:13.627077 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lazy-loading 'fault' on Instance uuid c233978f-9c32-47bf-8b66-44f0baa08830 {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:06:13.715129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:13.723944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f23a72e1-fbb0-47bf-a8b5-162f2454b104 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1312 microversion: 2.1 time: 0.204185 Dec 03 15:06:13.724514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 260/525] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:13 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:13.750681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7876b907-9a5e-40f7-a9bc-6a3074201742 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:13.751458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7876b907-9a5e-40f7-a9bc-6a3074201742 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:13.759713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7876b907-9a5e-40f7-a9bc-6a3074201742 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:13.760246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7876b907-9a5e-40f7-a9bc-6a3074201742 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:13.761095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7876b907-9a5e-40f7-a9bc-6a3074201742 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:13.761589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7876b907-9a5e-40f7-a9bc-6a3074201742 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:13.869231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2450e591-9d12-4754-ad22-2d18809a46a5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:13.877827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2450e591-9d12-4754-ad22-2d18809a46a5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:13.878317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2450e591-9d12-4754-ad22-2d18809a46a5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:13.944743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2450e591-9d12-4754-ad22-2d18809a46a5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Going to try to stop instance {{(pid=94373) force_stop /opt/stack/nova/nova/compute/api.py:2576}} Dec 03 15:06:13.997949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7876b907-9a5e-40f7-a9bc-6a3074201742 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:14.007249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7876b907-9a5e-40f7-a9bc-6a3074201742 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.266258 Dec 03 15:06:14.007861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 266/526] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:13 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:14.028293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2450e591-9d12-4754-ad22-2d18809a46a5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 202 len: 0 microversion: 2.1 time: 0.168496 Dec 03 15:06:14.028952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 261/527] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:06:13 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:06:14.043574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a0c2332d-52a5-4f9e-a6c4-629113c4bb9e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:14.044243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a0c2332d-52a5-4f9e-a6c4-629113c4bb9e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:14.052189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a0c2332d-52a5-4f9e-a6c4-629113c4bb9e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:14.052695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a0c2332d-52a5-4f9e-a6c4-629113c4bb9e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:14.053535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a0c2332d-52a5-4f9e-a6c4-629113c4bb9e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:14.054089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a0c2332d-52a5-4f9e-a6c4-629113c4bb9e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:14.271658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a0c2332d-52a5-4f9e-a6c4-629113c4bb9e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:14.281732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a0c2332d-52a5-4f9e-a6c4-629113c4bb9e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.248159 Dec 03 15:06:14.282364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 267/528] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:14 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:14.749718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:14.750524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:14.759476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:14.760046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:14.760987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:14.761478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:14.839501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:14.840001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:14.840503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lazy-loading 'fault' on Instance uuid c233978f-9c32-47bf-8b66-44f0baa08830 {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:06:14.908015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:14.917577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-36ada41d-5866-4bf4-baf8-a4a429be7f0f tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1312 microversion: 2.1 time: 0.178320 Dec 03 15:06:14.918274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 262/529] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:14 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:15.032881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f418f5e5-6e51-4cb4-968e-179b58daa161 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:15.033546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f418f5e5-6e51-4cb4-968e-179b58daa161 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:15.042086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f418f5e5-6e51-4cb4-968e-179b58daa161 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:15.042590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f418f5e5-6e51-4cb4-968e-179b58daa161 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:15.043423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f418f5e5-6e51-4cb4-968e-179b58daa161 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:15.043909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f418f5e5-6e51-4cb4-968e-179b58daa161 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:15.259993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f418f5e5-6e51-4cb4-968e-179b58daa161 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:15.268794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f418f5e5-6e51-4cb4-968e-179b58daa161 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.246968 Dec 03 15:06:15.269380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 268/530] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:15 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:15.306532 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c9b25b10-301d-4d11-83c2-7952f934c5ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:15.307193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c9b25b10-301d-4d11-83c2-7952f934c5ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:15.315119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9b25b10-301d-4d11-83c2-7952f934c5ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:15.315622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9b25b10-301d-4d11-83c2-7952f934c5ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:15.316455 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9b25b10-301d-4d11-83c2-7952f934c5ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:15.316943 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9b25b10-301d-4d11-83c2-7952f934c5ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:15.539866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c9b25b10-301d-4d11-83c2-7952f934c5ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:15.549252 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c9b25b10-301d-4d11-83c2-7952f934c5ef tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.252484 Dec 03 15:06:15.549842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 263/531] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:15 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:15.944545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:15.945217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:15.953434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:15.953966 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:15.954823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:15.955316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.038097 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.038603 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.039122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lazy-loading 'fault' on Instance uuid c233978f-9c32-47bf-8b66-44f0baa08830 {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:06:16.108039 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7384f2208849dc8fdfab81756ad1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f1305b325747b387eaa173734086a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:16.116828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-05408b10-d2e9-4c78-89a8-2189296d1206 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 200 len: 1312 microversion: 2.1 time: 0.184395 Dec 03 15:06:16.117420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 269/532] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:15 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:16.199526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5506741b-0b45-49e0-9e2b-c414496c3601 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:16.200696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5506741b-0b45-49e0-9e2b-c414496c3601 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:16.208665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5506741b-0b45-49e0-9e2b-c414496c3601 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.209169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5506741b-0b45-49e0-9e2b-c414496c3601 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.210042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5506741b-0b45-49e0-9e2b-c414496c3601 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.210530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5506741b-0b45-49e0-9e2b-c414496c3601 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.293316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f7556647-0ddf-41f4-81f6-f06a2b79735d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:16.294043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f7556647-0ddf-41f4-81f6-f06a2b79735d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:16.302113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7556647-0ddf-41f4-81f6-f06a2b79735d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.302608 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7556647-0ddf-41f4-81f6-f06a2b79735d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.303450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7556647-0ddf-41f4-81f6-f06a2b79735d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.303942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7556647-0ddf-41f4-81f6-f06a2b79735d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.367956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5506741b-0b45-49e0-9e2b-c414496c3601 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/action" status: 202 len: 0 microversion: 2.1 time: 0.177528 Dec 03 15:06:16.368606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 264/533] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:06:16 2020] POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:06:16.384881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4daa17c2-6c4c-49f2-9a1d-6b051c8f69aa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:16.385680 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4daa17c2-6c4c-49f2-9a1d-6b051c8f69aa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:16.394248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4daa17c2-6c4c-49f2-9a1d-6b051c8f69aa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.394939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4daa17c2-6c4c-49f2-9a1d-6b051c8f69aa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.395811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4daa17c2-6c4c-49f2-9a1d-6b051c8f69aa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.396310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4daa17c2-6c4c-49f2-9a1d-6b051c8f69aa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.609147 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f7556647-0ddf-41f4-81f6-f06a2b79735d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:16.621656 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f7556647-0ddf-41f4-81f6-f06a2b79735d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1265 microversion: 2.1 time: 0.337558 Dec 03 15:06:16.622379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 270/534] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:16 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:16.640178 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b2af80f2-8f8d-467f-a5c1-8b0c7d6b819d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:16.641032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b2af80f2-8f8d-467f-a5c1-8b0c7d6b819d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:16.649086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2af80f2-8f8d-467f-a5c1-8b0c7d6b819d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.649595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2af80f2-8f8d-467f-a5c1-8b0c7d6b819d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.651139 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2af80f2-8f8d-467f-a5c1-8b0c7d6b819d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:16.651632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2af80f2-8f8d-467f-a5c1-8b0c7d6b819d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:16.846394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4daa17c2-6c4c-49f2-9a1d-6b051c8f69aa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:16.857538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4daa17c2-6c4c-49f2-9a1d-6b051c8f69aa tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1759 microversion: 2.1 time: 0.483147 Dec 03 15:06:16.858359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 265/535] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:16 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1759 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:17.072872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b2af80f2-8f8d-467f-a5c1-8b0c7d6b819d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:17.082910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b2af80f2-8f8d-467f-a5c1-8b0c7d6b819d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.458838 Dec 03 15:06:17.083535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 271/536] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:16 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:17.140179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:17.140948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] [instance: c233978f-9c32-47bf-8b66-44f0baa08830] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:17.148999 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:17.149602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:17.150630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:17.151201 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:17.208250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] HTTP exception thrown: Instance c233978f-9c32-47bf-8b66-44f0baa08830 could not be found. Dec 03 15:06:17.208909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] Returning 404 to user: Instance c233978f-9c32-47bf-8b66-44f0baa08830 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:06:17.209809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-88daa5fe-9bdc-4a2b-a72a-4f225a9b8b93 tempest-ServerRescueNegativeTestJSON-167423433 tempest-ServerRescueNegativeTestJSON-167423433] 10.222.0.63 "GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830" status: 404 len: 111 microversion: 2.1 time: 0.079016 Dec 03 15:06:17.210485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 266/537] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:17 2020] GET /compute/v2.1/servers/c233978f-9c32-47bf-8b66-44f0baa08830 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:06:17.645891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9030a1a2-9029-471e-8a91-cbba2de5d5e6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:17.646605 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9030a1a2-9029-471e-8a91-cbba2de5d5e6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:17.655672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9030a1a2-9029-471e-8a91-cbba2de5d5e6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:17.656113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9030a1a2-9029-471e-8a91-cbba2de5d5e6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:17.656961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9030a1a2-9029-471e-8a91-cbba2de5d5e6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:17.657838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9030a1a2-9029-471e-8a91-cbba2de5d5e6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:17.887226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e8c9d2cc-9d64-48fa-b235-c79d22c4c816 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:17.888103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e8c9d2cc-9d64-48fa-b235-c79d22c4c816 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:17.908631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8c9d2cc-9d64-48fa-b235-c79d22c4c816 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:17.909315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8c9d2cc-9d64-48fa-b235-c79d22c4c816 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:17.910343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8c9d2cc-9d64-48fa-b235-c79d22c4c816 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:17.911018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8c9d2cc-9d64-48fa-b235-c79d22c4c816 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:18.248518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e8c9d2cc-9d64-48fa-b235-c79d22c4c816 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:18.264558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e8c9d2cc-9d64-48fa-b235-c79d22c4c816 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1759 microversion: 2.1 time: 0.392062 Dec 03 15:06:18.265707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 267/538] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:17 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1759 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:18.282441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-80394a9e-f4e2-41b8-b2e1-33888098cb53 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:18.283684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-80394a9e-f4e2-41b8-b2e1-33888098cb53 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:18.296446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80394a9e-f4e2-41b8-b2e1-33888098cb53 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:18.297662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80394a9e-f4e2-41b8-b2e1-33888098cb53 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:18.299266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80394a9e-f4e2-41b8-b2e1-33888098cb53 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:18.300508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80394a9e-f4e2-41b8-b2e1-33888098cb53 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:18.502368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9030a1a2-9029-471e-8a91-cbba2de5d5e6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:18.513207 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9030a1a2-9029-471e-8a91-cbba2de5d5e6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1449 microversion: 2.1 time: 0.876783 Dec 03 15:06:18.526599 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 272/539] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:17 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1449 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:18.540986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d69c0898-f244-4fe8-ad7c-debbc10bd8e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:18.542712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d69c0898-f244-4fe8-ad7c-debbc10bd8e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:18.551801 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d69c0898-f244-4fe8-ad7c-debbc10bd8e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:18.552607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d69c0898-f244-4fe8-ad7c-debbc10bd8e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:18.553776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d69c0898-f244-4fe8-ad7c-debbc10bd8e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:18.554667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d69c0898-f244-4fe8-ad7c-debbc10bd8e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:18.645453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-80394a9e-f4e2-41b8-b2e1-33888098cb53 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:18.658146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-80394a9e-f4e2-41b8-b2e1-33888098cb53 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.390981 Dec 03 15:06:18.659126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 268/540] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:18 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:19.012796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d69c0898-f244-4fe8-ad7c-debbc10bd8e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:19.037528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d69c0898-f244-4fe8-ad7c-debbc10bd8e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1449 microversion: 2.1 time: 0.505502 Dec 03 15:06:19.039085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 273/541] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:18 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1449 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:19.063865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e97600d4-e3d3-4450-b922-3c0faee8ec27 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'create', calling method: .version_select at 0x7fd5f610b950>, body: {"pool": null} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:19.291636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8f02dbb9-5db0-4aa9-b9b2-4c4bd601c183 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:19.293608 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8f02dbb9-5db0-4aa9-b9b2-4c4bd601c183 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:19.307912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f02dbb9-5db0-4aa9-b9b2-4c4bd601c183 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:19.308985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f02dbb9-5db0-4aa9-b9b2-4c4bd601c183 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:19.310125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f02dbb9-5db0-4aa9-b9b2-4c4bd601c183 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:19.310849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f02dbb9-5db0-4aa9-b9b2-4c4bd601c183 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:20.241064 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8f02dbb9-5db0-4aa9-b9b2-4c4bd601c183 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:20.258938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8f02dbb9-5db0-4aa9-b9b2-4c4bd601c183 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 0.979438 Dec 03 15:06:20.269987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 274/542] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:19 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:20.269987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-21472be5-2681-419a-a7c9-a1603b2e9608 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:20.270759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-21472be5-2681-419a-a7c9-a1603b2e9608 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:20.278483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21472be5-2681-419a-a7c9-a1603b2e9608 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:20.278996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21472be5-2681-419a-a7c9-a1603b2e9608 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:20.279853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21472be5-2681-419a-a7c9-a1603b2e9608 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:20.280348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21472be5-2681-419a-a7c9-a1603b2e9608 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:20.792255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-21472be5-2681-419a-a7c9-a1603b2e9608 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:20.820768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-21472be5-2681-419a-a7c9-a1603b2e9608 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.559871 Dec 03 15:06:20.824011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 275/543] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:20 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:21.286800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-78b7d49c-9cf0-4a87-a4ab-719161e08e0e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:21.290536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-78b7d49c-9cf0-4a87-a4ab-719161e08e0e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:21.301410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78b7d49c-9cf0-4a87-a4ab-719161e08e0e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:21.302218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78b7d49c-9cf0-4a87-a4ab-719161e08e0e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:21.304027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78b7d49c-9cf0-4a87-a4ab-719161e08e0e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:21.304907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78b7d49c-9cf0-4a87-a4ab-719161e08e0e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:21.842188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-78b7d49c-9cf0-4a87-a4ab-719161e08e0e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:21.861729 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-78b7d49c-9cf0-4a87-a4ab-719161e08e0e tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 0.586354 Dec 03 15:06:21.862592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 276/544] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:21 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:21.872989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e446c0ce-4652-42b8-9148-eff460225cb5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:21.874010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e446c0ce-4652-42b8-9148-eff460225cb5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:21.882479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e446c0ce-4652-42b8-9148-eff460225cb5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:21.883177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e446c0ce-4652-42b8-9148-eff460225cb5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:21.884704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e446c0ce-4652-42b8-9148-eff460225cb5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:21.885352 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e446c0ce-4652-42b8-9148-eff460225cb5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:22.017421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e97600d4-e3d3-4450-b922-3c0faee8ec27 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.964553 Dec 03 15:06:22.018252 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 269/545] 10.222.0.63 () {60 vars in 1160 bytes} [Thu Dec 3 15:06:19 2020] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:22.036954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'action', calling method: .version_select at 0x7fd5f78df048>, body: {"addFloatingIp": {"address": "172.27.2.57"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:22.040592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:22.050147 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:22.051154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:22.052239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:22.052930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:22.136886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Acquired lock "refresh_cache-add146c2-e4cc-491e-b5f9-17673e4a0c89" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:06:22.325954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e446c0ce-4652-42b8-9148-eff460225cb5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:22.345185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e446c0ce-4652-42b8-9148-eff460225cb5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.481251 Dec 03 15:06:22.361781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 277/546] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:21 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:22.888460 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1c2131fa-f006-4105-98d8-51624ba04058 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:22.895918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1c2131fa-f006-4105-98d8-51624ba04058 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:22.917279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c2131fa-f006-4105-98d8-51624ba04058 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:22.918001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c2131fa-f006-4105-98d8-51624ba04058 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:22.919010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c2131fa-f006-4105-98d8-51624ba04058 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:22.922842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c2131fa-f006-4105-98d8-51624ba04058 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:23.648630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1c2131fa-f006-4105-98d8-51624ba04058 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:23.660724 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1c2131fa-f006-4105-98d8-51624ba04058 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 0.782985 Dec 03 15:06:23.662169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 278/547] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:22 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:23.676460 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e8543cfd-802b-4845-8957-60bda28694ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:23.677140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e8543cfd-802b-4845-8957-60bda28694ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:23.697869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8543cfd-802b-4845-8957-60bda28694ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:23.698407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8543cfd-802b-4845-8957-60bda28694ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:23.699450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8543cfd-802b-4845-8957-60bda28694ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:23.700032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8543cfd-802b-4845-8957-60bda28694ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:24.358611 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e8543cfd-802b-4845-8957-60bda28694ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:24.385078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e8543cfd-802b-4845-8957-60bda28694ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.720920 Dec 03 15:06:24.386036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 279/548] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:23 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:24.686040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2f0f1eb5-c737-4ffc-ae34-8cd7cb49cbef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:24.695892 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2f0f1eb5-c737-4ffc-ae34-8cd7cb49cbef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:24.716142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f0f1eb5-c737-4ffc-ae34-8cd7cb49cbef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:24.716876 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f0f1eb5-c737-4ffc-ae34-8cd7cb49cbef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:24.717983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f0f1eb5-c737-4ffc-ae34-8cd7cb49cbef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:24.721536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f0f1eb5-c737-4ffc-ae34-8cd7cb49cbef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:24.741127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Building network info cache for instance {{(pid=94373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:06:25.785736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2f0f1eb5-c737-4ffc-ae34-8cd7cb49cbef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:25.815712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2f0f1eb5-c737-4ffc-ae34-8cd7cb49cbef tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 1.140511 Dec 03 15:06:25.816535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 280/549] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:24 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:25.838101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-c1e493cf-86f3-42b2-91be-c1f6f04e223b req-2abcb5e7-fff2-4d68-aee6-622970a939b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add146c2-e4cc-491e-b5f9-17673e4a0c89", "tag": "f82f881d-f8f0-478d-baa4-3c020c077e99"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:25.845415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:25.845415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:25.851491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Updating instance_info_cache with network_info: [{"id": "f82f881d-f8f0-478d-baa4-3c020c077e99", "address": "fa:16:3e:2b:f6:08", "network": {"id": "0d922ba7-749c-4c5e-b6cc-12813984389c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1471273793-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f77c18074b76496dbbd6d15835f35760", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapf82f881d-f8", "ovs_interfaceid": "f82f881d-f8f0-478d-baa4-3c020c077e99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:06:25.871240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Releasing lock "refresh_cache-add146c2-e4cc-491e-b5f9-17673e4a0c89" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:06:25.872549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6c405c3e-f385-4bec-a6e9-c01ba81c92e3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89/action" status: 202 len: 0 microversion: 2.1 time: 3.846455 Dec 03 15:06:25.873429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 270/550] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:06:22 2020] POST /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89/action => generated 0 bytes in 3848 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 15:06:25.878242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-c1e493cf-86f3-42b2-91be-c1f6f04e223b req-2abcb5e7-fff2-4d68-aee6-622970a939b3 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:25.882805 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-c1e493cf-86f3-42b2-91be-c1f6f04e223b req-2abcb5e7-fff2-4d68-aee6-622970a939b3 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:25.892190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-465a1896-d9fe-4867-9957-ea762a255de1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:25.898643 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-465a1896-d9fe-4867-9957-ea762a255de1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:25.919759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-465a1896-d9fe-4867-9957-ea762a255de1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:25.923931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-465a1896-d9fe-4867-9957-ea762a255de1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:25.925069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-465a1896-d9fe-4867-9957-ea762a255de1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:25.925781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-465a1896-d9fe-4867-9957-ea762a255de1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:25.930655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-c1e493cf-86f3-42b2-91be-c1f6f04e223b req-2abcb5e7-fff2-4d68-aee6-622970a939b3 service nova] Creating event network-changed:f82f881d-f8f0-478d-baa4-3c020c077e99 for instance add146c2-e4cc-491e-b5f9-17673e4a0c89 on hv-cinder-75790 Dec 03 15:06:25.950283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-c1e493cf-86f3-42b2-91be-c1f6f04e223b req-2abcb5e7-fff2-4d68-aee6-622970a939b3 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122155 Dec 03 15:06:25.951304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 281/551] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:25 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:26.268172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-465a1896-d9fe-4867-9957-ea762a255de1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:26.286958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-465a1896-d9fe-4867-9957-ea762a255de1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.412097 Dec 03 15:06:26.287815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 271/552] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:25 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:26.842807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5bc9cb12-5d9e-4e4b-b4d3-d5bedb541463 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:26.843578 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5bc9cb12-5d9e-4e4b-b4d3-d5bedb541463 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:26.854501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5bc9cb12-5d9e-4e4b-b4d3-d5bedb541463 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:26.855277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5bc9cb12-5d9e-4e4b-b4d3-d5bedb541463 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:26.856502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5bc9cb12-5d9e-4e4b-b4d3-d5bedb541463 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:26.857184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5bc9cb12-5d9e-4e4b-b4d3-d5bedb541463 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:27.315457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-31cfbe5f-d621-48d3-a95b-ac97bc42886e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:27.316141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-31cfbe5f-d621-48d3-a95b-ac97bc42886e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:27.326985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31cfbe5f-d621-48d3-a95b-ac97bc42886e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:27.327491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31cfbe5f-d621-48d3-a95b-ac97bc42886e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:27.328330 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31cfbe5f-d621-48d3-a95b-ac97bc42886e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:27.329028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31cfbe5f-d621-48d3-a95b-ac97bc42886e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:27.611215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-31cfbe5f-d621-48d3-a95b-ac97bc42886e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:27.622467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-31cfbe5f-d621-48d3-a95b-ac97bc42886e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.320129 Dec 03 15:06:27.623380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 272/553] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:27 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:27.879777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5bc9cb12-5d9e-4e4b-b4d3-d5bedb541463 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:27.892442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5bc9cb12-5d9e-4e4b-b4d3-d5bedb541463 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 1.061712 Dec 03 15:06:27.893515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 282/554] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:26 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:28.649035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-49b9a9b3-2203-4a7d-b908-874ebabff139 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:28.650177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-49b9a9b3-2203-4a7d-b908-874ebabff139 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:28.658744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-49b9a9b3-2203-4a7d-b908-874ebabff139 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:28.659583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-49b9a9b3-2203-4a7d-b908-874ebabff139 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:28.660688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-49b9a9b3-2203-4a7d-b908-874ebabff139 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:28.661148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-49b9a9b3-2203-4a7d-b908-874ebabff139 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:28.922430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-07631521-67f9-49ba-83ea-524003e96d16 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:28.923968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-07631521-67f9-49ba-83ea-524003e96d16 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:28.933529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-07631521-67f9-49ba-83ea-524003e96d16 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:28.935085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-07631521-67f9-49ba-83ea-524003e96d16 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:28.936047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-49b9a9b3-2203-4a7d-b908-874ebabff139 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:28.936618 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-07631521-67f9-49ba-83ea-524003e96d16 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:28.937294 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-07631521-67f9-49ba-83ea-524003e96d16 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:28.947537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-49b9a9b3-2203-4a7d-b908-874ebabff139 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.306731 Dec 03 15:06:28.948400 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 273/555] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:28 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:29.219966 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-07631521-67f9-49ba-83ea-524003e96d16 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:29.232726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-07631521-67f9-49ba-83ea-524003e96d16 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 0.323779 Dec 03 15:06:29.245051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 283/556] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:28 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:29.974376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-178b37cb-4ec6-48cf-9c9d-237e1c69000e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:29.975887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-178b37cb-4ec6-48cf-9c9d-237e1c69000e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:29.987598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-178b37cb-4ec6-48cf-9c9d-237e1c69000e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:29.988560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-178b37cb-4ec6-48cf-9c9d-237e1c69000e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:29.990162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-178b37cb-4ec6-48cf-9c9d-237e1c69000e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:29.990827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-178b37cb-4ec6-48cf-9c9d-237e1c69000e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:30.256441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eb6e84c4-d967-42e0-b90b-13ff11391b1b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:30.257531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-eb6e84c4-d967-42e0-b90b-13ff11391b1b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:30.266915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb6e84c4-d967-42e0-b90b-13ff11391b1b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:30.267659 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb6e84c4-d967-42e0-b90b-13ff11391b1b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:30.268967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb6e84c4-d967-42e0-b90b-13ff11391b1b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:30.269707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb6e84c4-d967-42e0-b90b-13ff11391b1b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:30.482769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-178b37cb-4ec6-48cf-9c9d-237e1c69000e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:30.501082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-178b37cb-4ec6-48cf-9c9d-237e1c69000e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.538011 Dec 03 15:06:30.502355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 274/557] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:29 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:30.716747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-eb6e84c4-d967-42e0-b90b-13ff11391b1b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:30.728196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eb6e84c4-d967-42e0-b90b-13ff11391b1b tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 0.480440 Dec 03 15:06:30.729563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 284/558] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:30 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:31.538740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d9c49894-b86c-459f-8feb-4c203fbd9963 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:31.543634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d9c49894-b86c-459f-8feb-4c203fbd9963 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:31.559751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d9c49894-b86c-459f-8feb-4c203fbd9963 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:31.560931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d9c49894-b86c-459f-8feb-4c203fbd9963 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:31.562156 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d9c49894-b86c-459f-8feb-4c203fbd9963 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:31.563372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d9c49894-b86c-459f-8feb-4c203fbd9963 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:31.905720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-364196374", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "b14368f7-35c6-4d91-831b-2eb7646e9222"}]}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:31.946554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d9c49894-b86c-459f-8feb-4c203fbd9963 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:31.967064 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d9c49894-b86c-459f-8feb-4c203fbd9963 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1680 microversion: 2.1 time: 0.451568 Dec 03 15:06:31.967883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 275/559] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:31 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1680 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:31.978750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d0db8467-2feb-4f1a-9228-49c2ed66e62f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:31.979718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d0db8467-2feb-4f1a-9228-49c2ed66e62f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:31.987884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0db8467-2feb-4f1a-9228-49c2ed66e62f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:31.988624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0db8467-2feb-4f1a-9228-49c2ed66e62f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:31.989637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0db8467-2feb-4f1a-9228-49c2ed66e62f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:31.990324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d0db8467-2feb-4f1a-9228-49c2ed66e62f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:32.015176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] validate_networks() for [('b14368f7-35c6-4d91-831b-2eb7646e9222', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:06:32.283357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d0db8467-2feb-4f1a-9228-49c2ed66e62f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:32.296386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d0db8467-2feb-4f1a-9228-49c2ed66e62f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 0.327000 Dec 03 15:06:32.298389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 276/560] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:31 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:32.931205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:06:32.931793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:06:32.932220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:06:32.932785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:06:32.933286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:06:32.943868 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:32.944526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:32.945471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:32.946022 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:32.970423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Getting quotas for project a474d63897e4433e9e4b034785e66430. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:06:32.980128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Getting quotas for user 0118cea2a12b4c81849eef6cfe727aea and project a474d63897e4433e9e4b034785e66430. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:06:32.992939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-805e968b-4e2b-4bd7-a87f-e590b121df8d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:32.993815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-805e968b-4e2b-4bd7-a87f-e590b121df8d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:33.002926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:06:33.005797 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:06:33.006495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-805e968b-4e2b-4bd7-a87f-e590b121df8d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:33.006992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-805e968b-4e2b-4bd7-a87f-e590b121df8d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:33.008008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-805e968b-4e2b-4bd7-a87f-e590b121df8d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:33.009463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-805e968b-4e2b-4bd7-a87f-e590b121df8d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:33.063354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-82733941-5edc-4a0c-be0c-845eadec8fa3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.458592 Dec 03 15:06:33.064336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 285/561] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:06:31 2020] POST /compute/v2.1/servers => generated 380 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:06:33.085764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e851b330-516a-402a-b687-307866363723 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:33.086585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e851b330-516a-402a-b687-307866363723 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:33.217973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e851b330-516a-402a-b687-307866363723 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:33.228317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e851b330-516a-402a-b687-307866363723 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1217 microversion: 2.1 time: 0.152483 Dec 03 15:06:33.229033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 286/562] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:33 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:33.327979 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-80ef9696-9c7b-43eb-a170-62c40a216464 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:33.328830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-80ef9696-9c7b-43eb-a170-62c40a216464 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:33.345752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80ef9696-9c7b-43eb-a170-62c40a216464 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:33.348396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80ef9696-9c7b-43eb-a170-62c40a216464 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:33.349406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80ef9696-9c7b-43eb-a170-62c40a216464 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:33.351969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-80ef9696-9c7b-43eb-a170-62c40a216464 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:33.405364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-805e968b-4e2b-4bd7-a87f-e590b121df8d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:33.424289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-805e968b-4e2b-4bd7-a87f-e590b121df8d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1657 microversion: 2.1 time: 0.440662 Dec 03 15:06:33.425175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 277/563] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:32 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1657 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:33.457206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-26c9b39c-19a7-4e41-ac0a-599d6d829a0e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:33.475768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-26c9b39c-19a7-4e41-ac0a-599d6d829a0e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:33.476290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-26c9b39c-19a7-4e41-ac0a-599d6d829a0e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:33.556309 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-26c9b39c-19a7-4e41-ac0a-599d6d829a0e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Going to try to start instance {{(pid=94373) start /opt/stack/nova/nova/compute/api.py:2599}} Dec 03 15:06:33.668773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-26c9b39c-19a7-4e41-ac0a-599d6d829a0e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action" status: 202 len: 0 microversion: 2.1 time: 0.227913 Dec 03 15:06:33.669354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 278/564] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:06:33 2020] POST /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:06:33.686395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2e376632-ae4c-4420-8201-342939535bb2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:33.687182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2e376632-ae4c-4420-8201-342939535bb2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:33.696148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e376632-ae4c-4420-8201-342939535bb2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:33.697342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e376632-ae4c-4420-8201-342939535bb2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:33.698263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e376632-ae4c-4420-8201-342939535bb2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:33.698803 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e376632-ae4c-4420-8201-342939535bb2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:33.710921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-80ef9696-9c7b-43eb-a170-62c40a216464 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:33.737668 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-80ef9696-9c7b-43eb-a170-62c40a216464 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 0.425708 Dec 03 15:06:33.738906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 287/565] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:33 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:33.982982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2e376632-ae4c-4420-8201-342939535bb2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:33.996700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2e376632-ae4c-4420-8201-342939535bb2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1666 microversion: 2.1 time: 0.322461 Dec 03 15:06:34.008748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 279/566] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:33 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1666 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:34.255179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bba3732a-42f6-4bed-aafa-2dd5dd7469a0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:34.255834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bba3732a-42f6-4bed-aafa-2dd5dd7469a0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:34.265949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bba3732a-42f6-4bed-aafa-2dd5dd7469a0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:34.265949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bba3732a-42f6-4bed-aafa-2dd5dd7469a0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:34.265949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bba3732a-42f6-4bed-aafa-2dd5dd7469a0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:34.265949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bba3732a-42f6-4bed-aafa-2dd5dd7469a0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:34.468416 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bba3732a-42f6-4bed-aafa-2dd5dd7469a0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:34.479630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bba3732a-42f6-4bed-aafa-2dd5dd7469a0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1269 microversion: 2.1 time: 0.237242 Dec 03 15:06:34.481020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 288/567] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:34 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:06:34.796717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e330a4f6-ca88-4883-ba1f-924beb8dbe36 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:34.798698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e330a4f6-ca88-4883-ba1f-924beb8dbe36 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:34.819697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e330a4f6-ca88-4883-ba1f-924beb8dbe36 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:34.820549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e330a4f6-ca88-4883-ba1f-924beb8dbe36 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:34.822666 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e330a4f6-ca88-4883-ba1f-924beb8dbe36 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:34.823363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e330a4f6-ca88-4883-ba1f-924beb8dbe36 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:35.021492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-09190370-c235-4bbd-a8cd-0fe25fc9e341 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:35.026513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-09190370-c235-4bbd-a8cd-0fe25fc9e341 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:35.048198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09190370-c235-4bbd-a8cd-0fe25fc9e341 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:35.048663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09190370-c235-4bbd-a8cd-0fe25fc9e341 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:35.049534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09190370-c235-4bbd-a8cd-0fe25fc9e341 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:35.050061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-09190370-c235-4bbd-a8cd-0fe25fc9e341 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:35.345684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e330a4f6-ca88-4883-ba1f-924beb8dbe36 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:35.370673 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e330a4f6-ca88-4883-ba1f-924beb8dbe36 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1764 microversion: 2.1 time: 0.612529 Dec 03 15:06:35.371693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 280/568] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:34 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1764 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:35.500887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-09190370-c235-4bbd-a8cd-0fe25fc9e341 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:35.504117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-787900d9-1b38-4e9f-8fb7-2732d023aa7f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:35.506793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-787900d9-1b38-4e9f-8fb7-2732d023aa7f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:35.517427 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-787900d9-1b38-4e9f-8fb7-2732d023aa7f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:35.518256 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-787900d9-1b38-4e9f-8fb7-2732d023aa7f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:35.519436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-787900d9-1b38-4e9f-8fb7-2732d023aa7f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:35.520080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-787900d9-1b38-4e9f-8fb7-2732d023aa7f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:35.532884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-09190370-c235-4bbd-a8cd-0fe25fc9e341 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1666 microversion: 2.1 time: 0.520700 Dec 03 15:06:35.533731 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 289/569] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:35 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1666 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:35.750746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-787900d9-1b38-4e9f-8fb7-2732d023aa7f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:35.766463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-787900d9-1b38-4e9f-8fb7-2732d023aa7f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1275 microversion: 2.1 time: 0.271880 Dec 03 15:06:35.767426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 281/570] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:35 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:36.408115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1ed60d75-1b8f-428f-a023-fbca91989779 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:36.408820 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1ed60d75-1b8f-428f-a023-fbca91989779 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:36.428735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1ed60d75-1b8f-428f-a023-fbca91989779 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:36.429336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1ed60d75-1b8f-428f-a023-fbca91989779 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:36.430410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1ed60d75-1b8f-428f-a023-fbca91989779 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:36.431650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1ed60d75-1b8f-428f-a023-fbca91989779 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:36.606490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-918523aa-dc6f-41b6-8e9c-0866ba78bb03 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:36.607218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-918523aa-dc6f-41b6-8e9c-0866ba78bb03 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:36.624029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-918523aa-dc6f-41b6-8e9c-0866ba78bb03 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:36.625141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-918523aa-dc6f-41b6-8e9c-0866ba78bb03 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:36.626078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-918523aa-dc6f-41b6-8e9c-0866ba78bb03 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:36.626588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-918523aa-dc6f-41b6-8e9c-0866ba78bb03 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:36.808312 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1ed60d75-1b8f-428f-a023-fbca91989779 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:36.820783 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1ed60d75-1b8f-428f-a023-fbca91989779 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1767 microversion: 2.1 time: 0.435194 Dec 03 15:06:36.822698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 290/571] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:36 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1767 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:36.836115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9e04ed3c-9c59-4cfb-94cb-12637e4f04d3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:36.837464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9e04ed3c-9c59-4cfb-94cb-12637e4f04d3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:36.846363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e04ed3c-9c59-4cfb-94cb-12637e4f04d3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:36.847742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e04ed3c-9c59-4cfb-94cb-12637e4f04d3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:36.848696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e04ed3c-9c59-4cfb-94cb-12637e4f04d3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:36.849386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e04ed3c-9c59-4cfb-94cb-12637e4f04d3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:37.077671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-918523aa-dc6f-41b6-8e9c-0866ba78bb03 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:37.091648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-918523aa-dc6f-41b6-8e9c-0866ba78bb03 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1670 microversion: 2.1 time: 0.530725 Dec 03 15:06:37.094071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 282/572] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:36 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1670 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:37.100949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9e04ed3c-9c59-4cfb-94cb-12637e4f04d3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:37.114718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9e04ed3c-9c59-4cfb-94cb-12637e4f04d3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1317 microversion: 2.1 time: 0.290335 Dec 03 15:06:37.115516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 291/573] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:36 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:38.136970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5e7d2e73-51af-4a6d-869e-0a96a5629e2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:38.137636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5e7d2e73-51af-4a6d-869e-0a96a5629e2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:38.145360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e7d2e73-51af-4a6d-869e-0a96a5629e2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:38.145866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e7d2e73-51af-4a6d-869e-0a96a5629e2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:38.146738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e7d2e73-51af-4a6d-869e-0a96a5629e2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:38.147277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e7d2e73-51af-4a6d-869e-0a96a5629e2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:38.505256 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-32cc4a90-96cd-4600-9304-1a1e56224ddb req-062b309b-1f6f-4ac8-91bf-82a0a51e5fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec457aab-c441-4e97-a4ff-58563d635312", "tag": "a55825db-cdc0-4b32-8a2a-482be28dafcc"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:38.512739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:38.512739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:38.521963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-32cc4a90-96cd-4600-9304-1a1e56224ddb req-062b309b-1f6f-4ac8-91bf-82a0a51e5fc3 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:38.522470 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-32cc4a90-96cd-4600-9304-1a1e56224ddb req-062b309b-1f6f-4ac8-91bf-82a0a51e5fc3 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:38.545015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-32cc4a90-96cd-4600-9304-1a1e56224ddb req-062b309b-1f6f-4ac8-91bf-82a0a51e5fc3 service nova] Creating event network-changed:a55825db-cdc0-4b32-8a2a-482be28dafcc for instance ec457aab-c441-4e97-a4ff-58563d635312 on hv-cinder-75790 Dec 03 15:06:38.551740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-32cc4a90-96cd-4600-9304-1a1e56224ddb req-062b309b-1f6f-4ac8-91bf-82a0a51e5fc3 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056249 Dec 03 15:06:38.553103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 292/574] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:38 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:06:38.647555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5e7d2e73-51af-4a6d-869e-0a96a5629e2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:38.657308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5e7d2e73-51af-4a6d-869e-0a96a5629e2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1317 microversion: 2.1 time: 0.529525 Dec 03 15:06:38.657888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 283/575] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:38 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:39.683465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-158852f5-eefd-4189-8f38-c01377e4f68e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:39.684245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-158852f5-eefd-4189-8f38-c01377e4f68e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:39.692434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-158852f5-eefd-4189-8f38-c01377e4f68e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:39.692919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-158852f5-eefd-4189-8f38-c01377e4f68e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:39.693768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-158852f5-eefd-4189-8f38-c01377e4f68e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:39.694311 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-158852f5-eefd-4189-8f38-c01377e4f68e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:39.919058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-158852f5-eefd-4189-8f38-c01377e4f68e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:39.927786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-158852f5-eefd-4189-8f38-c01377e4f68e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1317 microversion: 2.1 time: 0.255094 Dec 03 15:06:39.928379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 293/576] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:39 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:40.951819 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-65164c05-06cc-4190-b354-597037646552 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:40.952536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-65164c05-06cc-4190-b354-597037646552 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:40.960579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-65164c05-06cc-4190-b354-597037646552 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:40.961167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-65164c05-06cc-4190-b354-597037646552 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:40.962808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-65164c05-06cc-4190-b354-597037646552 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:40.962945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-65164c05-06cc-4190-b354-597037646552 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:41.185958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-65164c05-06cc-4190-b354-597037646552 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:41.195907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-65164c05-06cc-4190-b354-597037646552 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1317 microversion: 2.1 time: 0.253507 Dec 03 15:06:41.196611 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 284/577] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:40 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:42.220355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-423d58a5-f367-4423-a675-02cdf113bcef tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:42.221856 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-423d58a5-f367-4423-a675-02cdf113bcef tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:42.230920 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-423d58a5-f367-4423-a675-02cdf113bcef tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:42.231393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-423d58a5-f367-4423-a675-02cdf113bcef tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:42.232246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-423d58a5-f367-4423-a675-02cdf113bcef tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:42.232734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-423d58a5-f367-4423-a675-02cdf113bcef tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:42.408403 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-a0ce4e2f-ffe8-495b-95e0-80eae26df8f7 req-40cf27f8-221b-4672-b086-a251be31d913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec457aab-c441-4e97-a4ff-58563d635312", "name": "network-vif-plugged", "status": "completed", "tag": "a55825db-cdc0-4b32-8a2a-482be28dafcc"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:42.427372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:42.427372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:42.437953 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a0ce4e2f-ffe8-495b-95e0-80eae26df8f7 req-40cf27f8-221b-4672-b086-a251be31d913 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:42.438476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a0ce4e2f-ffe8-495b-95e0-80eae26df8f7 req-40cf27f8-221b-4672-b086-a251be31d913 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:42.460802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-a0ce4e2f-ffe8-495b-95e0-80eae26df8f7 req-40cf27f8-221b-4672-b086-a251be31d913 service nova] Creating event network-vif-plugged:a55825db-cdc0-4b32-8a2a-482be28dafcc for instance ec457aab-c441-4e97-a4ff-58563d635312 on hv-cinder-75790 Dec 03 15:06:42.467104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-a0ce4e2f-ffe8-495b-95e0-80eae26df8f7 req-40cf27f8-221b-4672-b086-a251be31d913 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068190 Dec 03 15:06:42.468439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 285/578] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:42 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:42.476326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-423d58a5-f367-4423-a675-02cdf113bcef tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:42.486266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-423d58a5-f367-4423-a675-02cdf113bcef tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1317 microversion: 2.1 time: 0.276273 Dec 03 15:06:42.486766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 294/579] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:42 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:43.509478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8c25f2d3-b747-4311-a8b5-a68294a922a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:43.510307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8c25f2d3-b747-4311-a8b5-a68294a922a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:43.518632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c25f2d3-b747-4311-a8b5-a68294a922a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:43.519154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c25f2d3-b747-4311-a8b5-a68294a922a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:43.520003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c25f2d3-b747-4311-a8b5-a68294a922a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:43.520501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c25f2d3-b747-4311-a8b5-a68294a922a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:43.740573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8c25f2d3-b747-4311-a8b5-a68294a922a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:43.750134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8c25f2d3-b747-4311-a8b5-a68294a922a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1317 microversion: 2.1 time: 0.250392 Dec 03 15:06:43.750949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 286/580] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:43 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:44.773864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3ad39c83-2553-4dde-9d9f-836ab03b0364 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:44.775352 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3ad39c83-2553-4dde-9d9f-836ab03b0364 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:44.783626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3ad39c83-2553-4dde-9d9f-836ab03b0364 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:44.784137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3ad39c83-2553-4dde-9d9f-836ab03b0364 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:44.784994 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3ad39c83-2553-4dde-9d9f-836ab03b0364 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:44.785495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3ad39c83-2553-4dde-9d9f-836ab03b0364 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:45.005610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3ad39c83-2553-4dde-9d9f-836ab03b0364 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:45.015536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3ad39c83-2553-4dde-9d9f-836ab03b0364 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1507 microversion: 2.1 time: 0.250972 Dec 03 15:06:45.016137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 295/581] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:44 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:46.610087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2626793a-d780-4555-865a-268a3b49bce1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9912b82-f82c-433f-9c18-436707d7b21b"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:46.611322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2626793a-d780-4555-865a-268a3b49bce1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:46.620376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2626793a-d780-4555-865a-268a3b49bce1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:46.620885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2626793a-d780-4555-865a-268a3b49bce1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:46.621730 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2626793a-d780-4555-865a-268a3b49bce1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:46.622252 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2626793a-d780-4555-865a-268a3b49bce1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:47.039510 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2626793a-d780-4555-865a-268a3b49bce1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439034 Dec 03 15:06:47.040427 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 287/582] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:06:46 2020] POST /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:06:55.114222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1832232042", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "b14368f7-35c6-4d91-831b-2eb7646e9222"}]}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:55.190834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] validate_networks() for [('b14368f7-35c6-4d91-831b-2eb7646e9222', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:06:55.967241 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:06:55.967725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:06:55.968315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:06:55.968782 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:06:55.969248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:06:55.978840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:55.979383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:55.980270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:55.980771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:56.000123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Getting quotas for project a474d63897e4433e9e4b034785e66430. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:06:56.004471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Getting quotas for user 0118cea2a12b4c81849eef6cfe727aea and project a474d63897e4433e9e4b034785e66430. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:06:56.015717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:06:56.018319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:06:56.069251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-84111a1b-821a-4fc6-893b-c80b1ffce933 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964193 Dec 03 15:06:56.069998 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 296/583] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:06:55 2020] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:06:56.086908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-83e4b4c7-6a70-46da-9876-10b26f43fc5c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:56.087437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-83e4b4c7-6a70-46da-9876-10b26f43fc5c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:56.178127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-83e4b4c7-6a70-46da-9876-10b26f43fc5c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:56.187014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-83e4b4c7-6a70-46da-9876-10b26f43fc5c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1218 microversion: 2.1 time: 0.110080 Dec 03 15:06:56.187623 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 288/584] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:56 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:57.211168 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bf92c279-e014-4de7-a988-266d64c0bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:57.211876 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bf92c279-e014-4de7-a988-266d64c0bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:57.220727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bf92c279-e014-4de7-a988-266d64c0bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:57.221245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bf92c279-e014-4de7-a988-266d64c0bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:57.222184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bf92c279-e014-4de7-a988-266d64c0bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:57.222689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bf92c279-e014-4de7-a988-266d64c0bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:57.360982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bf92c279-e014-4de7-a988-266d64c0bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:57.370738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bf92c279-e014-4de7-a988-266d64c0bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1278 microversion: 2.1 time: 0.168740 Dec 03 15:06:57.371598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 297/585] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:57 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:58.394463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eacd611d-ae7c-43da-8a4e-b80fa2d47ccf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:58.395137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-eacd611d-ae7c-43da-8a4e-b80fa2d47ccf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:58.410657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eacd611d-ae7c-43da-8a4e-b80fa2d47ccf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:58.411171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eacd611d-ae7c-43da-8a4e-b80fa2d47ccf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:58.412041 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eacd611d-ae7c-43da-8a4e-b80fa2d47ccf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:58.412535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eacd611d-ae7c-43da-8a4e-b80fa2d47ccf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:58.787421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-eacd611d-ae7c-43da-8a4e-b80fa2d47ccf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:06:58.797158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eacd611d-ae7c-43da-8a4e-b80fa2d47ccf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1318 microversion: 2.1 time: 0.412095 Dec 03 15:06:58.797585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 289/586] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:58 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:06:59.820359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6f5445b7-f831-4b08-b995-e0c52e4ce627 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:06:59.821039 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6f5445b7-f831-4b08-b995-e0c52e4ce627 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:06:59.829795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f5445b7-f831-4b08-b995-e0c52e4ce627 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:59.830346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f5445b7-f831-4b08-b995-e0c52e4ce627 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:59.831204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f5445b7-f831-4b08-b995-e0c52e4ce627 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:59.831705 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6f5445b7-f831-4b08-b995-e0c52e4ce627 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:59.919354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-6a49a17d-830c-4a48-bcd0-f780785173d3 req-7aaf39e6-f792-46ce-810b-2c412bce8d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237e9415-9a21-4351-b7c0-74006a517e0a", "tag": "053ac7af-3e23-4053-88ee-80372f87f915"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:06:59.926465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:06:59.926465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:06:59.936299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-6a49a17d-830c-4a48-bcd0-f780785173d3 req-7aaf39e6-f792-46ce-810b-2c412bce8d92 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:06:59.936897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-6a49a17d-830c-4a48-bcd0-f780785173d3 req-7aaf39e6-f792-46ce-810b-2c412bce8d92 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:06:59.954339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-6a49a17d-830c-4a48-bcd0-f780785173d3 req-7aaf39e6-f792-46ce-810b-2c412bce8d92 service nova] Creating event network-changed:053ac7af-3e23-4053-88ee-80372f87f915 for instance 237e9415-9a21-4351-b7c0-74006a517e0a on hv-cinder-75790 Dec 03 15:06:59.959365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-6a49a17d-830c-4a48-bcd0-f780785173d3 req-7aaf39e6-f792-46ce-810b-2c412bce8d92 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050205 Dec 03 15:06:59.960661 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 290/587] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:06:59 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:00.060462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6f5445b7-f831-4b08-b995-e0c52e4ce627 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:00.070484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6f5445b7-f831-4b08-b995-e0c52e4ce627 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1318 microversion: 2.1 time: 0.259296 Dec 03 15:07:00.071229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 298/588] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:06:59 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:00.337340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4ce9b92a-1463-4919-9e26-d14fb6fb354f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:00.338403 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4ce9b92a-1463-4919-9e26-d14fb6fb354f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:00.346571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ce9b92a-1463-4919-9e26-d14fb6fb354f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:00.347075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ce9b92a-1463-4919-9e26-d14fb6fb354f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:00.347917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ce9b92a-1463-4919-9e26-d14fb6fb354f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:00.348411 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4ce9b92a-1463-4919-9e26-d14fb6fb354f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:00.422653 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4ce9b92a-1463-4919-9e26-d14fb6fb354f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/os-volume_attachments/647fb357-21e8-4deb-a2af-d2e066d8090a" status: 200 len: 194 microversion: 2.20 time: 0.094974 Dec 03 15:07:00.423224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 291/589] 10.222.0.63 () {60 vars in 1444 bytes} [Thu Dec 3 15:07:00 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/os-volume_attachments/647fb357-21e8-4deb-a2af-d2e066d8090a => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:07:00.556316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5624633e-45e1-42a3-b782-cb5cd3c27466 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:00.557826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5624633e-45e1-42a3-b782-cb5cd3c27466 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:00.568114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5624633e-45e1-42a3-b782-cb5cd3c27466 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:00.568722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5624633e-45e1-42a3-b782-cb5cd3c27466 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:00.569771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5624633e-45e1-42a3-b782-cb5cd3c27466 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:00.570404 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5624633e-45e1-42a3-b782-cb5cd3c27466 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:00.861677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5624633e-45e1-42a3-b782-cb5cd3c27466 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "DELETE /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/os-volume_attachments/647fb357-21e8-4deb-a2af-d2e066d8090a" status: 202 len: 0 microversion: 2.20 time: 0.314726 Dec 03 15:07:00.862447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 299/590] 10.222.0.63 () {60 vars in 1447 bytes} [Thu Dec 3 15:07:00 2020] DELETE /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d/os-volume_attachments/647fb357-21e8-4deb-a2af-d2e066d8090a => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:07:01.094313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4dbc4d55-fcd6-45af-b3e0-9cdedb2a55c2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:01.094993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4dbc4d55-fcd6-45af-b3e0-9cdedb2a55c2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:01.102957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4dbc4d55-fcd6-45af-b3e0-9cdedb2a55c2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:01.103508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4dbc4d55-fcd6-45af-b3e0-9cdedb2a55c2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:01.104470 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4dbc4d55-fcd6-45af-b3e0-9cdedb2a55c2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:01.104860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4dbc4d55-fcd6-45af-b3e0-9cdedb2a55c2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:01.660720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4dbc4d55-fcd6-45af-b3e0-9cdedb2a55c2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:01.670523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4dbc4d55-fcd6-45af-b3e0-9cdedb2a55c2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1318 microversion: 2.1 time: 0.585722 Dec 03 15:07:01.671239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 292/591] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:01 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:02.694782 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-48fa2100-9979-4623-b67d-83c63365815d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:02.695566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-48fa2100-9979-4623-b67d-83c63365815d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:02.704675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48fa2100-9979-4623-b67d-83c63365815d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:02.705183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48fa2100-9979-4623-b67d-83c63365815d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:02.706066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48fa2100-9979-4623-b67d-83c63365815d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:02.706559 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-48fa2100-9979-4623-b67d-83c63365815d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:02.923057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-48fa2100-9979-4623-b67d-83c63365815d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:02.932742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-48fa2100-9979-4623-b67d-83c63365815d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1318 microversion: 2.1 time: 0.247588 Dec 03 15:07:02.933335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 300/592] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:02 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:03.192100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-aeba8d27-3ff8-40fd-ab16-17c9b33ca866 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:03.192657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-aeba8d27-3ff8-40fd-ab16-17c9b33ca866 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:03.202316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aeba8d27-3ff8-40fd-ab16-17c9b33ca866 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:03.202833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aeba8d27-3ff8-40fd-ab16-17c9b33ca866 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:03.203690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aeba8d27-3ff8-40fd-ab16-17c9b33ca866 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:03.204184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aeba8d27-3ff8-40fd-ab16-17c9b33ca866 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:03.278306 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-aeba8d27-3ff8-40fd-ab16-17c9b33ca866 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:07:03.397426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-aeba8d27-3ff8-40fd-ab16-17c9b33ca866 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "DELETE /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 204 len: 0 microversion: 2.20 time: 0.214079 Dec 03 15:07:03.398062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 293/593] 10.222.0.63 () {60 vars in 1270 bytes} [Thu Dec 3 15:07:03 2020] DELETE /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 03 15:07:03.414796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:03.415496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:03.423790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:03.424293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:03.425139 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:03.425635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:03.649388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:03.664488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:03.671897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:03.673092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8fd54fac-fc66-4437-9556-ac9b2f02f5e0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.268616 Dec 03 15:07:03.673687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 301/594] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:03 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:03.956710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-703d724e-43b4-4f36-b136-435be260ffd2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:03.957403 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-703d724e-43b4-4f36-b136-435be260ffd2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:03.965494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-703d724e-43b4-4f36-b136-435be260ffd2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:03.966024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-703d724e-43b4-4f36-b136-435be260ffd2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:03.966858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-703d724e-43b4-4f36-b136-435be260ffd2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:03.967347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-703d724e-43b4-4f36-b136-435be260ffd2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:04.198322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-703d724e-43b4-4f36-b136-435be260ffd2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:04.207170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-703d724e-43b4-4f36-b136-435be260ffd2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1318 microversion: 2.1 time: 0.260478 Dec 03 15:07:04.207703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 294/595] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:03 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:04.662197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-d548298e-b1a2-440e-b3ee-da8c86bff5bb req-1957778f-2dc1-4d24-be53-dd8d810aa3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237e9415-9a21-4351-b7c0-74006a517e0a", "name": "network-vif-plugged", "status": "completed", "tag": "053ac7af-3e23-4053-88ee-80372f87f915"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:04.669636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:04.669636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:04.678864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d548298e-b1a2-440e-b3ee-da8c86bff5bb req-1957778f-2dc1-4d24-be53-dd8d810aa3c8 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:04.679365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d548298e-b1a2-440e-b3ee-da8c86bff5bb req-1957778f-2dc1-4d24-be53-dd8d810aa3c8 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:04.698158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-d548298e-b1a2-440e-b3ee-da8c86bff5bb req-1957778f-2dc1-4d24-be53-dd8d810aa3c8 service nova] Creating event network-vif-plugged:053ac7af-3e23-4053-88ee-80372f87f915 for instance 237e9415-9a21-4351-b7c0-74006a517e0a on hv-cinder-75790 Dec 03 15:07:04.701114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:04.701891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:04.703374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-d548298e-b1a2-440e-b3ee-da8c86bff5bb req-1957778f-2dc1-4d24-be53-dd8d810aa3c8 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052215 Dec 03 15:07:04.704192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 302/596] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:04 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:04.710341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:04.710858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:04.711716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:04.712212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:04.945926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:04.960502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:04.967908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:04.969109 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2e7c76c4-a3a0-46bc-b857-e35f92c00140 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.278363 Dec 03 15:07:04.969696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 295/597] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:04 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:05.231450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c64f78cb-21db-4831-926b-b3b8350a989a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:05.232223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c64f78cb-21db-4831-926b-b3b8350a989a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:05.240361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c64f78cb-21db-4831-926b-b3b8350a989a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:05.240877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c64f78cb-21db-4831-926b-b3b8350a989a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:05.241722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c64f78cb-21db-4831-926b-b3b8350a989a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:05.242244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c64f78cb-21db-4831-926b-b3b8350a989a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:05.472150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c64f78cb-21db-4831-926b-b3b8350a989a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:05.480965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c64f78cb-21db-4831-926b-b3b8350a989a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1318 microversion: 2.1 time: 0.259879 Dec 03 15:07:05.481572 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 303/598] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:05 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:05.995145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:05.995832 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:06.003744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:06.004221 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:06.005069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:06.005563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:06.227894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:06.243167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:06.250331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:06.251513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3e5b9de4-2420-4d58-bec8-cb22a3013b66 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1722 microversion: 2.20 time: 0.266684 Dec 03 15:07:06.252281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 296/599] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:05 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:06.507786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-62bcd747-2a58-4fbd-8fda-33d7340deb1c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:06.509058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-62bcd747-2a58-4fbd-8fda-33d7340deb1c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:06.521982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-62bcd747-2a58-4fbd-8fda-33d7340deb1c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:06.522464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-62bcd747-2a58-4fbd-8fda-33d7340deb1c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:06.523322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-62bcd747-2a58-4fbd-8fda-33d7340deb1c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:06.523813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-62bcd747-2a58-4fbd-8fda-33d7340deb1c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:06.751585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-62bcd747-2a58-4fbd-8fda-33d7340deb1c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:06.767044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-62bcd747-2a58-4fbd-8fda-33d7340deb1c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1318 microversion: 2.1 time: 0.270915 Dec 03 15:07:06.767580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 304/600] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:06 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:07.277129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:07.277933 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:07.285882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:07.286426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:07.287275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:07.287764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:07.538159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:07.554802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:07.563582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:07.565622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c0d16367-6902-4bdf-8310-5bb42def6ae9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1655 microversion: 2.20 time: 0.298502 Dec 03 15:07:07.566765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 297/601] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:07 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1655 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:07.791538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-86cd3131-f739-47f9-8a68-b146eeb8167d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:07.792432 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-86cd3131-f739-47f9-8a68-b146eeb8167d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:07.801248 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86cd3131-f739-47f9-8a68-b146eeb8167d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:07.801984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86cd3131-f739-47f9-8a68-b146eeb8167d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:07.803004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86cd3131-f739-47f9-8a68-b146eeb8167d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:07.803646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86cd3131-f739-47f9-8a68-b146eeb8167d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:07.852253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-5bbe659e-84f5-4c93-8a34-964d129d7f8a req-52dc30ff-cb90-42fe-99bb-ab18e8d3ca11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53f7d53-2ae6-4edd-84c2-09e523498d7d", "name": "network-vif-deleted", "tag": "6e8050ed-0789-4bcc-bbe2-11f953a2e2ed"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:07.863333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:07.863333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:07.874283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-5bbe659e-84f5-4c93-8a34-964d129d7f8a req-52dc30ff-cb90-42fe-99bb-ab18e8d3ca11 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:07.883528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-5bbe659e-84f5-4c93-8a34-964d129d7f8a req-52dc30ff-cb90-42fe-99bb-ab18e8d3ca11 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:07.904432 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-5bbe659e-84f5-4c93-8a34-964d129d7f8a req-52dc30ff-cb90-42fe-99bb-ab18e8d3ca11 service nova] Creating event network-vif-deleted:6e8050ed-0789-4bcc-bbe2-11f953a2e2ed for instance f53f7d53-2ae6-4edd-84c2-09e523498d7d on hv-cinder-75790 Dec 03 15:07:07.909279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-5bbe659e-84f5-4c93-8a34-964d129d7f8a req-52dc30ff-cb90-42fe-99bb-ab18e8d3ca11 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079397 Dec 03 15:07:07.909944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 298/602] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:07 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:08.064799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-86cd3131-f739-47f9-8a68-b146eeb8167d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:08.075145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-86cd3131-f739-47f9-8a68-b146eeb8167d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1508 microversion: 2.1 time: 0.292958 Dec 03 15:07:08.075963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 305/603] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:07 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:08.101957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9912b82-f82c-433f-9c18-436707d7b21b"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:08.104004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:08.112376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:08.112886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:08.113741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:08.114316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:08.588537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] HTTP exception thrown: Invalid input received: Invalid volume: Volume f9912b82-f82c-433f-9c18-436707d7b21b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-91482082-ec26-489e-8774-e9d5325bd651) Dec 03 15:07:08.590481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Returning 400 to user: Invalid input received: Invalid volume: Volume f9912b82-f82c-433f-9c18-436707d7b21b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-91482082-ec26-489e-8774-e9d5325bd651) {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:07:08.592370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-54eb909f-a2d2-490e-a198-f77e5d50bc53 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.501747 Dec 03 15:07:08.594503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:08.594689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 299/604] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:07:08 2020] POST /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a/os-volume_attachments => generated 279 bytes in 505 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 03 15:07:08.595911 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:08.623348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:08.627134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:08.628582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:08.629646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:08.781182 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:08.781395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-405beb8d-d32c-4aaa-a7c0-4551f1443513 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:08.782847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:08.783512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lazy-loading 'fault' on Instance uuid f53f7d53-2ae6-4edd-84c2-09e523498d7d {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:07:08.786610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-405beb8d-d32c-4aaa-a7c0-4551f1443513 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:08.829647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-405beb8d-d32c-4aaa-a7c0-4551f1443513 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:08.831750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-405beb8d-d32c-4aaa-a7c0-4551f1443513 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:08.832761 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-405beb8d-d32c-4aaa-a7c0-4551f1443513 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:08.833149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-405beb8d-d32c-4aaa-a7c0-4551f1443513 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:08.878655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:08.894810 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:08.902489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:08.903907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c1251ead-b058-4e7f-bde7-0377340fcf19 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 200 len: 1371 microversion: 2.20 time: 0.321604 Dec 03 15:07:08.904954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 306/605] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:08 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:09.130336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-405beb8d-d32c-4aaa-a7c0-4551f1443513 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "DELETE /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312/os-volume_attachments/f9912b82-f82c-433f-9c18-436707d7b21b" status: 202 len: 0 microversion: 2.1 time: 0.392519 Dec 03 15:07:09.131217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 300/606] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:07:08 2020] DELETE /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312/os-volume_attachments/f9912b82-f82c-433f-9c18-436707d7b21b => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:09.928896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:09.930253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:09.939931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:09.940590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:09.941554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:09.942191 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:09.997316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] HTTP exception thrown: Instance f53f7d53-2ae6-4edd-84c2-09e523498d7d could not be found. Dec 03 15:07:09.997990 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Returning 404 to user: Instance f53f7d53-2ae6-4edd-84c2-09e523498d7d could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:07:09.998895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1a59f196-100b-4142-b1b3-ca5e2704f28f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 404 len: 111 microversion: 2.20 time: 0.079429 Dec 03 15:07:09.999727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 307/607] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:09 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 03 15:07:10.015830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8c7dc08a-d770-499a-9a8d-7f9f83a45ee6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '.version_select at 0x7fd5fabed8c8>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:10.037841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8c7dc08a-d770-499a-9a8d-7f9f83a45ee6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468958215" status: 204 len: 0 microversion: 2.20 time: 0.032949 Dec 03 15:07:10.038510 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 301/608] 10.222.0.63 () {60 vars in 1249 bytes} [Thu Dec 3 15:07:10 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468958215 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 03 15:07:11.432502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a6a65c45-6880-47c7-a319-23977671aca0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'create', calling method: .version_select at 0x7fd5fabe8378>, body: {"keypair": {"name": "tempest-keypair-1323975429"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:11.463679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a6a65c45-6880-47c7-a319-23977671aca0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for project f608c43dc4544cf8abe2b82be12c9880. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:07:11.468763 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a6a65c45-6880-47c7-a319-23977671aca0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for user 02eb117eb6b349819521771a97d3ff11 and project f608c43dc4544cf8abe2b82be12c9880. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:07:11.525595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1230473450", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "b14368f7-35c6-4d91-831b-2eb7646e9222"}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:11.870542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] validate_networks() for [('b14368f7-35c6-4d91-831b-2eb7646e9222', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:07:12.069210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a6a65c45-6880-47c7-a319-23977671aca0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for project f608c43dc4544cf8abe2b82be12c9880. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:07:12.073633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a6a65c45-6880-47c7-a319-23977671aca0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for user 02eb117eb6b349819521771a97d3ff11 and project f608c43dc4544cf8abe2b82be12c9880. Resources: {'key_pairs'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:07:12.087152 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a6a65c45-6880-47c7-a319-23977671aca0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.665160 Dec 03 15:07:12.087890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 308/609] 10.222.0.63 () {62 vars in 1189 bytes} [Thu Dec 3 15:07:11 2020] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 667 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 03 15:07:12.488773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:07:12.489727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:07:12.490210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:07:12.490341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:07:12.490787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:07:12.502892 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:12.503460 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:12.504364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:12.504860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:12.527366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Getting quotas for project a474d63897e4433e9e4b034785e66430. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:07:12.532637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Getting quotas for user 0118cea2a12b4c81849eef6cfe727aea and project a474d63897e4433e9e4b034785e66430. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:07:12.545377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:07:12.550849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:07:12.613530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2a815162-ab71-48c8-97cb-e2b934c1add9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.097348 Dec 03 15:07:12.620125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 302/610] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:07:11 2020] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:07:12.635645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3072ae6b-54ba-4cb2-a1c8-a60f3a7e0dcb tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:12.635838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3072ae6b-54ba-4cb2-a1c8-a60f3a7e0dcb tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:13.086604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3072ae6b-54ba-4cb2-a1c8-a60f3a7e0dcb tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:13.096509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3072ae6b-54ba-4cb2-a1c8-a60f3a7e0dcb tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1218 microversion: 2.1 time: 0.473957 Dec 03 15:07:13.097121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 309/611] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:12 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1218 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:14.129478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cb7998f5-c5b7-40a3-adaa-b3ed5ca8aab1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:14.133675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cb7998f5-c5b7-40a3-adaa-b3ed5ca8aab1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:14.146017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb7998f5-c5b7-40a3-adaa-b3ed5ca8aab1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:14.146845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb7998f5-c5b7-40a3-adaa-b3ed5ca8aab1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:14.148494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb7998f5-c5b7-40a3-adaa-b3ed5ca8aab1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:14.149215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cb7998f5-c5b7-40a3-adaa-b3ed5ca8aab1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:14.316338 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cb7998f5-c5b7-40a3-adaa-b3ed5ca8aab1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:14.326850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cb7998f5-c5b7-40a3-adaa-b3ed5ca8aab1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1288 microversion: 2.1 time: 0.206593 Dec 03 15:07:14.327651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 303/612] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:14 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1288 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:14.668131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-307388138", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b89cab8b-b39a-4106-adb3-9bedf452bb83"}], "security_groups": [{"name": "tempest-securitygroup--2082906466"}], "key_name": "tempest-keypair-1323975429", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:14.829984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] validate_networks() for [('b89cab8b-b39a-4106-adb3-9bedf452bb83', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:07:15.350024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-175dd862-b317-4aea-881b-c385b449280f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:15.350859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-175dd862-b317-4aea-881b-c385b449280f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:15.359884 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-175dd862-b317-4aea-881b-c385b449280f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:15.360394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-175dd862-b317-4aea-881b-c385b449280f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:15.361247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-175dd862-b317-4aea-881b-c385b449280f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:15.361741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-175dd862-b317-4aea-881b-c385b449280f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:15.418793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:07:15.419969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:07:15.420735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:07:15.421399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:07:15.422633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:07:15.433965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:15.434487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:15.435370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:15.435866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:15.454853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for project f608c43dc4544cf8abe2b82be12c9880. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:07:15.459263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Getting quotas for user 02eb117eb6b349819521771a97d3ff11 and project f608c43dc4544cf8abe2b82be12c9880. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:07:15.471648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:07:15.474305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:07:15.527196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8456aec0-6886-48c1-aa75-b1b9dc832d48 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.869455 Dec 03 15:07:15.528080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 310/613] 10.222.0.63 () {62 vars in 1178 bytes} [Thu Dec 3 15:07:14 2020] POST /compute/v2.1/servers => generated 402 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 03 15:07:15.544641 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-25cbac11-a2e0-4b4c-b581-541b5dcb1d9e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:15.545316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-25cbac11-a2e0-4b4c-b581-541b5dcb1d9e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:15.636658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-25cbac11-a2e0-4b4c-b581-541b5dcb1d9e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:15.653222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-25cbac11-a2e0-4b4c-b581-541b5dcb1d9e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:15.660098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-25cbac11-a2e0-4b4c-b581-541b5dcb1d9e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:15.661125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-25cbac11-a2e0-4b4c-b581-541b5dcb1d9e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1281 microversion: 2.20 time: 0.126632 Dec 03 15:07:15.674923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 311/614] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:15 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1281 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:07:15.838489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-175dd862-b317-4aea-881b-c385b449280f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:15.847768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-175dd862-b317-4aea-881b-c385b449280f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1318 microversion: 2.1 time: 0.506849 Dec 03 15:07:15.849016 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 304/615] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:15 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:16.688012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:16.688722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:16.696643 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:16.697148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:16.698275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:16.698790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:16.873051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-87f8f6eb-7ea0-4682-8185-82d1b8597b20 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:16.873727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-87f8f6eb-7ea0-4682-8185-82d1b8597b20 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:16.883290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87f8f6eb-7ea0-4682-8185-82d1b8597b20 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:16.883791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87f8f6eb-7ea0-4682-8185-82d1b8597b20 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:16.884696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87f8f6eb-7ea0-4682-8185-82d1b8597b20 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:16.885180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87f8f6eb-7ea0-4682-8185-82d1b8597b20 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:16.910096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:16.927595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:16.936077 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:16.937366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1140d823-29ab-4e12-919e-17acf8b2aa76 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1333 microversion: 2.20 time: 0.259746 Dec 03 15:07:16.938403 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 312/616] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:16 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1333 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:17.239759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-0b5ddcf6-8ab5-4e19-a89d-6a163f4ac5d2 req-3917f6cf-06b6-4993-958e-83c4b2ef639e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36a1db4-149e-42e3-b996-ad70b23479b6", "tag": "fdbe9e9c-8f3f-4fa7-9499-ca87a100ee37"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:17.248880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:17.248880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:17.259889 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-0b5ddcf6-8ab5-4e19-a89d-6a163f4ac5d2 req-3917f6cf-06b6-4993-958e-83c4b2ef639e service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:17.261777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-0b5ddcf6-8ab5-4e19-a89d-6a163f4ac5d2 req-3917f6cf-06b6-4993-958e-83c4b2ef639e service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:17.284696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-0b5ddcf6-8ab5-4e19-a89d-6a163f4ac5d2 req-3917f6cf-06b6-4993-958e-83c4b2ef639e service nova] Creating event network-changed:fdbe9e9c-8f3f-4fa7-9499-ca87a100ee37 for instance c36a1db4-149e-42e3-b996-ad70b23479b6 on hv-cinder-75790 Dec 03 15:07:17.293039 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-0b5ddcf6-8ab5-4e19-a89d-6a163f4ac5d2 req-3917f6cf-06b6-4993-958e-83c4b2ef639e service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061750 Dec 03 15:07:17.294441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 313/617] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:17 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:17.507503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-87f8f6eb-7ea0-4682-8185-82d1b8597b20 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:17.518292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-87f8f6eb-7ea0-4682-8185-82d1b8597b20 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1318 microversion: 2.1 time: 0.655428 Dec 03 15:07:17.519439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 305/618] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:16 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:17.967298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:17.968089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:17.976462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:17.977831 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:17.980200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:17.980708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:18.118172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:18.133642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:18.140902 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:18.142151 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5c031996-e7d5-4eb8-9fee-ecd05ab2e746 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1339 microversion: 2.20 time: 0.187075 Dec 03 15:07:18.142740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 314/619] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:17 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:18.543199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-99838c2a-972b-44b9-aef8-cf8b2959a88d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:18.543995 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-99838c2a-972b-44b9-aef8-cf8b2959a88d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:18.552009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99838c2a-972b-44b9-aef8-cf8b2959a88d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:18.552600 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99838c2a-972b-44b9-aef8-cf8b2959a88d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:18.553529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99838c2a-972b-44b9-aef8-cf8b2959a88d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:18.554145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99838c2a-972b-44b9-aef8-cf8b2959a88d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:19.109949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-99838c2a-972b-44b9-aef8-cf8b2959a88d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:19.118929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-99838c2a-972b-44b9-aef8-cf8b2959a88d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1318 microversion: 2.1 time: 0.585193 Dec 03 15:07:19.119823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 306/620] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:18 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:19.170094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:19.170759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:19.179928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:19.180697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:19.182922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:19.183429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:19.417634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:19.433587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:19.440237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:19.441412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c92f516c-1637-478d-bff4-274797379a9a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1407 microversion: 2.20 time: 0.282761 Dec 03 15:07:19.442081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 315/621] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:19 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:20.142507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4b327ba9-031f-481a-bec7-fa70a1f7b953 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:20.143759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4b327ba9-031f-481a-bec7-fa70a1f7b953 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:20.152518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b327ba9-031f-481a-bec7-fa70a1f7b953 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:20.153025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b327ba9-031f-481a-bec7-fa70a1f7b953 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:20.153882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b327ba9-031f-481a-bec7-fa70a1f7b953 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:20.154511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b327ba9-031f-481a-bec7-fa70a1f7b953 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:20.466513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:20.467193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:20.475196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:20.475729 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:20.476589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:20.477088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:20.554485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4b327ba9-031f-481a-bec7-fa70a1f7b953 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:20.563938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4b327ba9-031f-481a-bec7-fa70a1f7b953 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1318 microversion: 2.1 time: 0.430977 Dec 03 15:07:20.564536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 307/622] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:20 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:20.711702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:20.727359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:20.735090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:20.736265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8ab7c74c-3328-44b6-8377-f5a85d6a602a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1407 microversion: 2.20 time: 0.280427 Dec 03 15:07:20.736865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 316/623] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:20 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:07:21.501385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-d932ec1f-dbc3-4e98-8711-cbda9244bca4 req-5f4ba216-ed18-47f2-b437-d31032911337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2dedaf2-51f5-458f-8e08-7814bc6780c3", "tag": "0b68efc4-0565-4c23-9acc-fbbc726bba64"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:21.509936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:21.509936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:21.519201 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d932ec1f-dbc3-4e98-8711-cbda9244bca4 req-5f4ba216-ed18-47f2-b437-d31032911337 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:21.519628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d932ec1f-dbc3-4e98-8711-cbda9244bca4 req-5f4ba216-ed18-47f2-b437-d31032911337 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:21.538491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-d932ec1f-dbc3-4e98-8711-cbda9244bca4 req-5f4ba216-ed18-47f2-b437-d31032911337 service nova] Creating event network-changed:0b68efc4-0565-4c23-9acc-fbbc726bba64 for instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 on hv-cinder-75790 Dec 03 15:07:21.544648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-d932ec1f-dbc3-4e98-8711-cbda9244bca4 req-5f4ba216-ed18-47f2-b437-d31032911337 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056574 Dec 03 15:07:21.545355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 308/624] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:21 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:21.587299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4638337d-fed6-4013-993f-77f74deb4a9a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:21.588711 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4638337d-fed6-4013-993f-77f74deb4a9a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:21.597315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4638337d-fed6-4013-993f-77f74deb4a9a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:21.598026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4638337d-fed6-4013-993f-77f74deb4a9a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:21.598998 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4638337d-fed6-4013-993f-77f74deb4a9a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:21.599685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4638337d-fed6-4013-993f-77f74deb4a9a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:21.767685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:21.771462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:21.795443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:21.796227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:21.797405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:21.798205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:21.854498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4638337d-fed6-4013-993f-77f74deb4a9a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:21.863241 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4638337d-fed6-4013-993f-77f74deb4a9a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1318 microversion: 2.1 time: 0.285459 Dec 03 15:07:21.864063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 317/625] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:21 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:22.220415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:22.235508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:22.242141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:22.243292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-dba9c1c9-0a9d-4b75-9a1a-fb63b79143e4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1407 microversion: 2.20 time: 0.489928 Dec 03 15:07:22.244627 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 309/626] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:21 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:22.844323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-fc6bf5e8-7e32-468b-b50b-c053e65f1928 req-19c25abe-434f-48c2-bb29-6df17e52ed07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36a1db4-149e-42e3-b996-ad70b23479b6", "name": "network-vif-plugged", "status": "completed", "tag": "fdbe9e9c-8f3f-4fa7-9499-ca87a100ee37"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:22.851188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:22.851188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:22.861304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-fc6bf5e8-7e32-468b-b50b-c053e65f1928 req-19c25abe-434f-48c2-bb29-6df17e52ed07 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:22.861602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-fc6bf5e8-7e32-468b-b50b-c053e65f1928 req-19c25abe-434f-48c2-bb29-6df17e52ed07 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:22.882106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-fc6bf5e8-7e32-468b-b50b-c053e65f1928 req-19c25abe-434f-48c2-bb29-6df17e52ed07 service nova] Creating event network-vif-plugged:fdbe9e9c-8f3f-4fa7-9499-ca87a100ee37 for instance c36a1db4-149e-42e3-b996-ad70b23479b6 on hv-cinder-75790 Dec 03 15:07:22.896753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-fc6bf5e8-7e32-468b-b50b-c053e65f1928 req-19c25abe-434f-48c2-bb29-6df17e52ed07 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063356 Dec 03 15:07:22.898033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 318/627] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:22 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:22.902886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-38333e32-5367-42f9-860b-547c8be504a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:22.903648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-38333e32-5367-42f9-860b-547c8be504a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:22.911547 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38333e32-5367-42f9-860b-547c8be504a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:22.912289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38333e32-5367-42f9-860b-547c8be504a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:22.913174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38333e32-5367-42f9-860b-547c8be504a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:22.913668 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38333e32-5367-42f9-860b-547c8be504a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:23.269932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:23.270716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:23.280215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:23.280758 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:23.281615 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:23.282185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:23.518834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:23.534342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:23.540888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:23.542103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-24a1abf8-3a54-40ba-a725-df06c9749a39 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1407 microversion: 2.20 time: 0.282442 Dec 03 15:07:23.542706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 319/628] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:23 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:23.664876 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-38333e32-5367-42f9-860b-547c8be504a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:23.674298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-38333e32-5367-42f9-860b-547c8be504a3 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1318 microversion: 2.1 time: 0.783108 Dec 03 15:07:23.674914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 310/629] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:22 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:23.921862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d74fb029-f497-4002-8aec-180c11de24be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:23.922414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d74fb029-f497-4002-8aec-180c11de24be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:23.930247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d74fb029-f497-4002-8aec-180c11de24be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:23.931043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d74fb029-f497-4002-8aec-180c11de24be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:23.931918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d74fb029-f497-4002-8aec-180c11de24be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:23.932406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d74fb029-f497-4002-8aec-180c11de24be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:24.003655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d74fb029-f497-4002-8aec-180c11de24be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:07:24.125127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d74fb029-f497-4002-8aec-180c11de24be tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 204 len: 0 microversion: 2.1 time: 0.212774 Dec 03 15:07:24.125902 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 320/630] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:07:23 2020] DELETE /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:07:24.141291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-55e02a3d-de08-445f-94e4-59801994ff2f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:24.142001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-55e02a3d-de08-445f-94e4-59801994ff2f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:24.149859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55e02a3d-de08-445f-94e4-59801994ff2f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:24.150453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55e02a3d-de08-445f-94e4-59801994ff2f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:24.151307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55e02a3d-de08-445f-94e4-59801994ff2f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:24.151802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55e02a3d-de08-445f-94e4-59801994ff2f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:24.372219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-55e02a3d-de08-445f-94e4-59801994ff2f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:24.380943 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-55e02a3d-de08-445f-94e4-59801994ff2f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1676 microversion: 2.1 time: 0.250426 Dec 03 15:07:24.381530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 311/631] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:24 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:24.568697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:24.569474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:24.578004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:24.578527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:24.579383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:24.579885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:24.698366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-324acb4f-af0a-44a0-ac4c-952592730971 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:24.699164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-324acb4f-af0a-44a0-ac4c-952592730971 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:24.707351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-324acb4f-af0a-44a0-ac4c-952592730971 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:24.707952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-324acb4f-af0a-44a0-ac4c-952592730971 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:24.708886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-324acb4f-af0a-44a0-ac4c-952592730971 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:24.709475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-324acb4f-af0a-44a0-ac4c-952592730971 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:24.824970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:24.841212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:24.847905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:24.849063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-50b87b43-fd26-404c-a0ef-627a3c94ceaa tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1407 microversion: 2.20 time: 0.291181 Dec 03 15:07:24.849680 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 321/632] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:24 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:24.939101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-324acb4f-af0a-44a0-ac4c-952592730971 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:24.948872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-324acb4f-af0a-44a0-ac4c-952592730971 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1318 microversion: 2.1 time: 0.259871 Dec 03 15:07:24.949466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 312/633] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:24 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:25.407052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1fa3f5ff-357b-496d-8d47-4130fcba265b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:25.407814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1fa3f5ff-357b-496d-8d47-4130fcba265b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:25.416783 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1fa3f5ff-357b-496d-8d47-4130fcba265b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:25.417281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1fa3f5ff-357b-496d-8d47-4130fcba265b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:25.418150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1fa3f5ff-357b-496d-8d47-4130fcba265b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:25.418641 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1fa3f5ff-357b-496d-8d47-4130fcba265b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:25.644165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1fa3f5ff-357b-496d-8d47-4130fcba265b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:25.653471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1fa3f5ff-357b-496d-8d47-4130fcba265b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1676 microversion: 2.1 time: 0.257231 Dec 03 15:07:25.654087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 322/634] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:25 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1676 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:25.873421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:25.874122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:25.882545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:25.883054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:25.883898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:25.885054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:25.973371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f1289194-efdb-458f-9a63-5c184a5c357f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:25.974098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f1289194-efdb-458f-9a63-5c184a5c357f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:25.982682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1289194-efdb-458f-9a63-5c184a5c357f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:25.983195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1289194-efdb-458f-9a63-5c184a5c357f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:25.984045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1289194-efdb-458f-9a63-5c184a5c357f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:25.984541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f1289194-efdb-458f-9a63-5c184a5c357f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:26.113700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:26.129470 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:26.137131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:26.138367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3b42ad57-d876-4fab-8498-75f838450b17 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1407 microversion: 2.20 time: 0.274198 Dec 03 15:07:26.138968 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 313/635] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:25 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:26.215169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f1289194-efdb-458f-9a63-5c184a5c357f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:26.224198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f1289194-efdb-458f-9a63-5c184a5c357f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1507 microversion: 2.1 time: 0.261545 Dec 03 15:07:26.224835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 323/636] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:25 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:26.823973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3db0ad1b-7385-4425-8095-c6adadba7a60 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:26.824636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3db0ad1b-7385-4425-8095-c6adadba7a60 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:26.832596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3db0ad1b-7385-4425-8095-c6adadba7a60 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:26.833097 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3db0ad1b-7385-4425-8095-c6adadba7a60 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:26.833944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3db0ad1b-7385-4425-8095-c6adadba7a60 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:26.834473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3db0ad1b-7385-4425-8095-c6adadba7a60 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:27.063313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3db0ad1b-7385-4425-8095-c6adadba7a60 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:27.077386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3db0ad1b-7385-4425-8095-c6adadba7a60 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1676 microversion: 2.1 time: 0.408896 Dec 03 15:07:27.079232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-bb028cbf-fdbb-4f58-b2b8-de1a59a4728a req-59b5b440-f478-405e-96cc-e6e1ffe942ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2dedaf2-51f5-458f-8e08-7814bc6780c3", "name": "network-vif-plugged", "status": "completed", "tag": "0b68efc4-0565-4c23-9acc-fbbc726bba64"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:27.086563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:27.086563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:27.088660 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 314/637] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:26 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1676 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:27.096353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-bb028cbf-fdbb-4f58-b2b8-de1a59a4728a req-59b5b440-f478-405e-96cc-e6e1ffe942ee service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:27.096858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-bb028cbf-fdbb-4f58-b2b8-de1a59a4728a req-59b5b440-f478-405e-96cc-e6e1ffe942ee service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:27.115699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-bb028cbf-fdbb-4f58-b2b8-de1a59a4728a req-59b5b440-f478-405e-96cc-e6e1ffe942ee service nova] Creating event network-vif-plugged:0b68efc4-0565-4c23-9acc-fbbc726bba64 for instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 on hv-cinder-75790 Dec 03 15:07:27.122021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-bb028cbf-fdbb-4f58-b2b8-de1a59a4728a req-59b5b440-f478-405e-96cc-e6e1ffe942ee service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053158 Dec 03 15:07:27.122703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 324/638] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:27 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:27.163299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:27.164113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:27.173046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:27.173569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:27.174512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:27.175008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:27.632414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:27.647229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:27.654696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:27.655858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-59c0807c-1876-4ccc-9635-1df326ebc0d3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1407 microversion: 2.20 time: 0.502673 Dec 03 15:07:27.656450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 315/639] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:27 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:27.815332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b5eb2ebf-367b-46e1-8853-5aad1c4555d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc609b51-f84a-466d-b350-b1b740c61505"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:27.816617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b5eb2ebf-367b-46e1-8853-5aad1c4555d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:27.825515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5eb2ebf-367b-46e1-8853-5aad1c4555d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:27.826069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5eb2ebf-367b-46e1-8853-5aad1c4555d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:27.826908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5eb2ebf-367b-46e1-8853-5aad1c4555d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:27.827394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5eb2ebf-367b-46e1-8853-5aad1c4555d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:28.101708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-13a0a72d-4f7d-4b3e-a687-2209c18e75bf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:28.102445 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-13a0a72d-4f7d-4b3e-a687-2209c18e75bf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:28.110827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13a0a72d-4f7d-4b3e-a687-2209c18e75bf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:28.111612 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13a0a72d-4f7d-4b3e-a687-2209c18e75bf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:28.112436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13a0a72d-4f7d-4b3e-a687-2209c18e75bf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:28.113112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-13a0a72d-4f7d-4b3e-a687-2209c18e75bf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:28.300557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b5eb2ebf-367b-46e1-8853-5aad1c4555d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495997 Dec 03 15:07:28.301551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 325/640] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:07:27 2020] POST /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:28.530465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-13a0a72d-4f7d-4b3e-a687-2209c18e75bf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:28.539779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-13a0a72d-4f7d-4b3e-a687-2209c18e75bf tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1676 microversion: 2.1 time: 0.447292 Dec 03 15:07:28.541745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 316/641] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:28 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1676 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:28.682408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:28.683177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:28.692186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:28.692711 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:28.693562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:28.694107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:28.924932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:28.940888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:28.948479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:28.949679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-aecac867-8449-447b-b9f1-d5ca85c96d7a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1407 microversion: 2.20 time: 0.277367 Dec 03 15:07:28.950415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 326/642] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:28 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:29.378764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-cc7c110c-679b-4dc0-abe0-442e1e3867a0 req-143f44b3-a95e-4dfd-b43e-97a83d6b7420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5082cea-6dd3-41d3-9210-f5e8bd37f651", "name": "network-vif-deleted", "tag": "e835912e-98c3-4b70-bf9b-467e0fcfcd78"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:29.391516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:29.391516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:29.402741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-cc7c110c-679b-4dc0-abe0-442e1e3867a0 req-143f44b3-a95e-4dfd-b43e-97a83d6b7420 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:29.403255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-cc7c110c-679b-4dc0-abe0-442e1e3867a0 req-143f44b3-a95e-4dfd-b43e-97a83d6b7420 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:29.428519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-cc7c110c-679b-4dc0-abe0-442e1e3867a0 req-143f44b3-a95e-4dfd-b43e-97a83d6b7420 service nova] Creating event network-vif-deleted:e835912e-98c3-4b70-bf9b-467e0fcfcd78 for instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 on hv-cinder-75790 Dec 03 15:07:29.434437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-cc7c110c-679b-4dc0-abe0-442e1e3867a0 req-143f44b3-a95e-4dfd-b43e-97a83d6b7420 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066161 Dec 03 15:07:29.435428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 317/643] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:29 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:29.564559 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:29.565244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:29.575022 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:29.575441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:29.576533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:29.577036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:29.658156 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:29.658576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:29.659093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lazy-loading 'fault' on Instance uuid d5082cea-6dd3-41d3-9210-f5e8bd37f651 {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:07:29.726736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:29.735935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-763a7bf5-bca7-4148-b9c6-23567ca00501 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 200 len: 1328 microversion: 2.1 time: 0.181149 Dec 03 15:07:29.736535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 327/644] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:29 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 1328 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:29.975704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:29.976482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:29.985225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:29.985726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:29.986720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:29.987143 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:30.233534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:30.248787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:30.255439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:30.256698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f944da0e-100c-4b8d-88b0-62dead7ce7a8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1600 microversion: 2.20 time: 0.291556 Dec 03 15:07:30.257516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 318/645] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:07:29 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1600 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:07:30.282440 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d3440b4a-ab0a-4458-b989-83a1105ec643 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:30.282995 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d3440b4a-ab0a-4458-b989-83a1105ec643 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:30.290824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d3440b4a-ab0a-4458-b989-83a1105ec643 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:30.291917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d3440b4a-ab0a-4458-b989-83a1105ec643 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:30.292775 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d3440b4a-ab0a-4458-b989-83a1105ec643 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:30.293293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d3440b4a-ab0a-4458-b989-83a1105ec643 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:30.454921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d3440b4a-ab0a-4458-b989-83a1105ec643 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.182793 Dec 03 15:07:30.455572 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 328/646] 10.222.0.63 () {60 vars in 1306 bytes} [Thu Dec 3 15:07:30 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:07:30.770677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:30.771653 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:30.794352 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:30.795328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:30.795987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:30.796481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:30.863443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] HTTP exception thrown: Instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 could not be found. Dec 03 15:07:30.864128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Returning 404 to user: Instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:07:30.865032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-606e3c71-2bde-444c-a0a7-f9223a2af08b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 404 len: 111 microversion: 2.1 time: 0.113817 Dec 03 15:07:30.865655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 319/647] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:30 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:07:30.880497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b5b03048-a689-4423-a48b-a44895cf2ea6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '.version_select at 0x7fd5fabe88c8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:30.903331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b5b03048-a689-4423-a48b-a44895cf2ea6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349560221" status: 202 len: 0 microversion: 2.1 time: 0.032523 Dec 03 15:07:30.904080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 329/648] 10.222.0.63 () {58 vars in 1211 bytes} [Thu Dec 3 15:07:30 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349560221 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:07:32.067827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-732b03bd-d51f-47f8-b5c3-a0b9a55b887b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:32.068879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-732b03bd-d51f-47f8-b5c3-a0b9a55b887b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:32.073023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-35a3ea7d-e3e9-4ad9-be9e-fc761bf9e38e req-800c8f98-cc99-4793-8c51-3c8eba9d0342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2dedaf2-51f5-458f-8e08-7814bc6780c3", "tag": "0b68efc4-0565-4c23-9acc-fbbc726bba64"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:32.076866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-732b03bd-d51f-47f8-b5c3-a0b9a55b887b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:32.077377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-732b03bd-d51f-47f8-b5c3-a0b9a55b887b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:32.078275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-732b03bd-d51f-47f8-b5c3-a0b9a55b887b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:32.078774 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-732b03bd-d51f-47f8-b5c3-a0b9a55b887b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:32.079944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:32.079944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:32.091563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-35a3ea7d-e3e9-4ad9-be9e-fc761bf9e38e req-800c8f98-cc99-4793-8c51-3c8eba9d0342 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:32.092121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-35a3ea7d-e3e9-4ad9-be9e-fc761bf9e38e req-800c8f98-cc99-4793-8c51-3c8eba9d0342 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:32.112527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-35a3ea7d-e3e9-4ad9-be9e-fc761bf9e38e req-800c8f98-cc99-4793-8c51-3c8eba9d0342 service nova] Creating event network-changed:0b68efc4-0565-4c23-9acc-fbbc726bba64 for instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 on hv-cinder-75790 Dec 03 15:07:32.116310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-35a3ea7d-e3e9-4ad9-be9e-fc761bf9e38e req-800c8f98-cc99-4793-8c51-3c8eba9d0342 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054558 Dec 03 15:07:32.117189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 330/649] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:32 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:07:32.233018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-732b03bd-d51f-47f8-b5c3-a0b9a55b887b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.174013 Dec 03 15:07:32.236909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 320/650] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:32 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:33.251351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e528bad6-0289-45ba-b675-b5c12b9de8b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:33.252781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e528bad6-0289-45ba-b675-b5c12b9de8b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:33.261894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e528bad6-0289-45ba-b675-b5c12b9de8b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:33.262669 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e528bad6-0289-45ba-b675-b5c12b9de8b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:33.263604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e528bad6-0289-45ba-b675-b5c12b9de8b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:33.264166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e528bad6-0289-45ba-b675-b5c12b9de8b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:33.433455 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e528bad6-0289-45ba-b675-b5c12b9de8b8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.191989 Dec 03 15:07:33.437385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 331/651] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:33 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:33.585049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-58986201-8912-4a2b-890a-fadf2d86aa3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'create', calling method: .version_select at 0x7fd5f610b7b8>, body: {"keypair": {"name": "tempest-keypair-1117614595"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:33.619430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-58986201-8912-4a2b-890a-fadf2d86aa3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:07:33.623768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-58986201-8912-4a2b-890a-fadf2d86aa3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for user dd9a3fdb0a0c44f6bdebf91a5d4e77b8 and project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:07:33.804189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-58986201-8912-4a2b-890a-fadf2d86aa3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:07:33.808974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-58986201-8912-4a2b-890a-fadf2d86aa3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for user dd9a3fdb0a0c44f6bdebf91a5d4e77b8 and project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:07:33.823019 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-58986201-8912-4a2b-890a-fadf2d86aa3a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.249815 Dec 03 15:07:33.829189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 321/652] 10.222.0.63 () {60 vars in 1148 bytes} [Thu Dec 3 15:07:33 2020] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:34.452552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9f2f4392-77dd-43ee-a623-9dab37446c2e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:34.453719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9f2f4392-77dd-43ee-a623-9dab37446c2e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:34.463742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9f2f4392-77dd-43ee-a623-9dab37446c2e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:34.464123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9f2f4392-77dd-43ee-a623-9dab37446c2e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:34.465009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9f2f4392-77dd-43ee-a623-9dab37446c2e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:34.465540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9f2f4392-77dd-43ee-a623-9dab37446c2e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:34.617558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9f2f4392-77dd-43ee-a623-9dab37446c2e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.175574 Dec 03 15:07:34.618521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 332/653] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:34 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:35.637891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2e6986b9-aa45-4108-a831-5a80ee027e94 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:35.639123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2e6986b9-aa45-4108-a831-5a80ee027e94 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:35.648345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e6986b9-aa45-4108-a831-5a80ee027e94 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:35.648943 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e6986b9-aa45-4108-a831-5a80ee027e94 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:35.650192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e6986b9-aa45-4108-a831-5a80ee027e94 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:35.650907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e6986b9-aa45-4108-a831-5a80ee027e94 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:35.802381 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2e6986b9-aa45-4108-a831-5a80ee027e94 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.175844 Dec 03 15:07:35.803068 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 322/654] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:35 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:36.245253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1803645326", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2263eb43-6c9e-40c3-9734-975854f0ad70"}], "security_groups": [{"name": "tempest-securitygroup--1842139128"}], "key_name": "tempest-keypair-1117614595", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:36.247749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc609b51-f84a-466d-b350-b1b740c61505"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:36.249125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:36.257835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:36.258405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:36.259255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:36.260544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:36.340911 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] HTTP exception thrown: Invalid volume: volume fc609b51-f84a-466d-b350-b1b740c61505 already attached Dec 03 15:07:36.341578 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Returning 400 to user: Invalid volume: volume fc609b51-f84a-466d-b350-b1b740c61505 already attached {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:07:36.342505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f3c06135-3708-4c5d-9316-98808d372703 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.110439 Dec 03 15:07:36.343330 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 333/655] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:07:36 2020] POST /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6/os-volume_attachments => generated 120 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 03 15:07:36.393500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] validate_networks() for [('2263eb43-6c9e-40c3-9734-975854f0ad70', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:07:36.463528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7fc3fe9b-16da-4e87-bbc1-b73983477b70 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:36.464473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7fc3fe9b-16da-4e87-bbc1-b73983477b70 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:36.472545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7fc3fe9b-16da-4e87-bbc1-b73983477b70 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:36.473140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7fc3fe9b-16da-4e87-bbc1-b73983477b70 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:36.474030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7fc3fe9b-16da-4e87-bbc1-b73983477b70 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:36.474533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7fc3fe9b-16da-4e87-bbc1-b73983477b70 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:36.772778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7fc3fe9b-16da-4e87-bbc1-b73983477b70 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "DELETE /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6/os-volume_attachments/fc609b51-f84a-466d-b350-b1b740c61505" status: 202 len: 0 microversion: 2.1 time: 0.319287 Dec 03 15:07:36.773846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 334/656] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:07:36 2020] DELETE /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6/os-volume_attachments/fc609b51-f84a-466d-b350-b1b740c61505 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:07:36.820762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f7afba6a-69c1-4ab0-836a-9c170b5c65ec tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:36.824361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f7afba6a-69c1-4ab0-836a-9c170b5c65ec tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:36.842878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7afba6a-69c1-4ab0-836a-9c170b5c65ec tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:36.843694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7afba6a-69c1-4ab0-836a-9c170b5c65ec tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:36.844709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7afba6a-69c1-4ab0-836a-9c170b5c65ec tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:36.845348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f7afba6a-69c1-4ab0-836a-9c170b5c65ec tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:36.996388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f7afba6a-69c1-4ab0-836a-9c170b5c65ec tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.185236 Dec 03 15:07:36.997074 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 335/657] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:36 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:37.023208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:07:37.023652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:07:37.024234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:07:37.024713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:07:37.025796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:07:37.035757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:37.036254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:37.037170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:37.037848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:37.056931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:07:37.061037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Getting quotas for user dd9a3fdb0a0c44f6bdebf91a5d4e77b8 and project 1bf6d3149aee44a798e51e0135d17c5f. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:07:37.073355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:07:37.076126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:07:37.127090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-db663c9f-94c7-4ce6-a7b8-09ede1d455da tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.892262 Dec 03 15:07:37.129718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 323/658] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:07:36 2020] POST /compute/v2.1/servers => generated 402 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:07:37.145682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-41a50f01-fe2c-4bf6-9046-1101286d04dd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:37.146573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-41a50f01-fe2c-4bf6-9046-1101286d04dd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:37.467571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-41a50f01-fe2c-4bf6-9046-1101286d04dd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:37.476180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-41a50f01-fe2c-4bf6-9046-1101286d04dd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1238 microversion: 2.1 time: 0.341418 Dec 03 15:07:37.477099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 336/659] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:37 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1238 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:38.016090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-898ff9fb-5305-4fac-aa4f-0851be422638 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:38.017483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-898ff9fb-5305-4fac-aa4f-0851be422638 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:38.028906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-898ff9fb-5305-4fac-aa4f-0851be422638 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:38.029456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-898ff9fb-5305-4fac-aa4f-0851be422638 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:38.031057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-898ff9fb-5305-4fac-aa4f-0851be422638 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:38.031611 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-898ff9fb-5305-4fac-aa4f-0851be422638 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:38.200092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-898ff9fb-5305-4fac-aa4f-0851be422638 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.195693 Dec 03 15:07:38.203647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 324/660] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:38 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:38.500506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6d6ebebe-c635-4d43-a264-3252c08a2d49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:38.501193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6d6ebebe-c635-4d43-a264-3252c08a2d49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:38.511491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6d6ebebe-c635-4d43-a264-3252c08a2d49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:38.511998 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6d6ebebe-c635-4d43-a264-3252c08a2d49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:38.512852 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6d6ebebe-c635-4d43-a264-3252c08a2d49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:38.513357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6d6ebebe-c635-4d43-a264-3252c08a2d49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:38.649859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6d6ebebe-c635-4d43-a264-3252c08a2d49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:38.659043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6d6ebebe-c635-4d43-a264-3252c08a2d49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1290 microversion: 2.1 time: 0.167971 Dec 03 15:07:38.659652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 337/661] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:38 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1290 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:39.172468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-304828005", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "b14368f7-35c6-4d91-831b-2eb7646e9222"}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:39.217633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b9a303bb-431d-4725-8da8-1bcbd342a274 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:39.218655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b9a303bb-431d-4725-8da8-1bcbd342a274 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:39.226790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b9a303bb-431d-4725-8da8-1bcbd342a274 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:39.227305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b9a303bb-431d-4725-8da8-1bcbd342a274 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:39.228159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b9a303bb-431d-4725-8da8-1bcbd342a274 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:39.229218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b9a303bb-431d-4725-8da8-1bcbd342a274 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:39.257209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] validate_networks() for [('b14368f7-35c6-4d91-831b-2eb7646e9222', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:07:39.371231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b9a303bb-431d-4725-8da8-1bcbd342a274 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.163163 Dec 03 15:07:39.371845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 338/662] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:39 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:39.684469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-621e3939-0e60-421b-8ecb-66968de9140b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:39.685395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-621e3939-0e60-421b-8ecb-66968de9140b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:39.694176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-621e3939-0e60-421b-8ecb-66968de9140b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:39.694696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-621e3939-0e60-421b-8ecb-66968de9140b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:39.695687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-621e3939-0e60-421b-8ecb-66968de9140b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:39.696192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-621e3939-0e60-421b-8ecb-66968de9140b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:39.850322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-621e3939-0e60-421b-8ecb-66968de9140b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:39.860026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-621e3939-0e60-421b-8ecb-66968de9140b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1296 microversion: 2.1 time: 0.186680 Dec 03 15:07:39.860807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 339/663] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:39 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1296 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:40.388262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9a51478a-cd2b-4aff-a2c0-965d84749dff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:40.389315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9a51478a-cd2b-4aff-a2c0-965d84749dff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:40.397270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a51478a-cd2b-4aff-a2c0-965d84749dff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:40.397774 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a51478a-cd2b-4aff-a2c0-965d84749dff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:40.398652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a51478a-cd2b-4aff-a2c0-965d84749dff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:40.399141 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a51478a-cd2b-4aff-a2c0-965d84749dff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:40.545189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9a51478a-cd2b-4aff-a2c0-965d84749dff tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.165951 Dec 03 15:07:40.545807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 340/664] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:40 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:40.557340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-764269b8-dc83-4734-9ffa-1af2904470bd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-35739318"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:40.558038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-764269b8-dc83-4734-9ffa-1af2904470bd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:40.566658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-764269b8-dc83-4734-9ffa-1af2904470bd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:40.567164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-764269b8-dc83-4734-9ffa-1af2904470bd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:40.568001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-764269b8-dc83-4734-9ffa-1af2904470bd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:40.568490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-764269b8-dc83-4734-9ffa-1af2904470bd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:40.631824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:07:40.632456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:07:40.633283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:07:40.633859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:07:40.635467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:07:40.645762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:40.646469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:40.647482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:40.648087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:40.674261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Getting quotas for project a474d63897e4433e9e4b034785e66430. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:07:40.679351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Getting quotas for user 0118cea2a12b4c81849eef6cfe727aea and project a474d63897e4433e9e4b034785e66430. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:07:40.693769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:07:40.696956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:07:40.769290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a4e3a80a-3aa3-4933-a78a-0967163005c5 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.607171 Dec 03 15:07:40.770740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 325/665] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:07:39 2020] POST /compute/v2.1/servers => generated 380 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:07:40.800194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-18c989e7-0b80-4181-9083-90b3e54f1e12 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:40.801072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-18c989e7-0b80-4181-9083-90b3e54f1e12 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:40.918079 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-18c989e7-0b80-4181-9083-90b3e54f1e12 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:40.929779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-18c989e7-0b80-4181-9083-90b3e54f1e12 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1217 microversion: 2.1 time: 0.151924 Dec 03 15:07:40.930562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 326/666] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:40 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:40.945830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a918f1c0-faf2-4e14-b79b-7de4d0d226bd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:40.946262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.network.security_group_api [None req-764269b8-dc83-4734-9ffa-1af2904470bd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Removing security group 5ffdf135-388f-48b5-bce4-3a1c9059bc68 from port afe54511-8f8c-42eb-8ca3-b2337f457222 Dec 03 15:07:40.947136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a918f1c0-faf2-4e14-b79b-7de4d0d226bd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:40.956138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a918f1c0-faf2-4e14-b79b-7de4d0d226bd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:40.956886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a918f1c0-faf2-4e14-b79b-7de4d0d226bd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:40.958219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a918f1c0-faf2-4e14-b79b-7de4d0d226bd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:40.958931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a918f1c0-faf2-4e14-b79b-7de4d0d226bd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:41.503414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a918f1c0-faf2-4e14-b79b-7de4d0d226bd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:41.513738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a918f1c0-faf2-4e14-b79b-7de4d0d226bd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1364 microversion: 2.1 time: 0.581083 Dec 03 15:07:41.514723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 327/667] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:40 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1364 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:41.571395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-61aeb4a9-3505-4f90-94e7-bb20c4e172e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:41.573418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-61aeb4a9-3505-4f90-94e7-bb20c4e172e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:41.588896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-61aeb4a9-3505-4f90-94e7-bb20c4e172e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:41.589922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-61aeb4a9-3505-4f90-94e7-bb20c4e172e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:41.591056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-61aeb4a9-3505-4f90-94e7-bb20c4e172e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:41.591738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-61aeb4a9-3505-4f90-94e7-bb20c4e172e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:41.704715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-764269b8-dc83-4734-9ffa-1af2904470bd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/action" status: 202 len: 0 microversion: 2.1 time: 1.157436 Dec 03 15:07:41.705944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 341/668] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:07:40 2020] POST /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/action => generated 0 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:41.719852 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-eb24f95b-9e34-41a3-92c5-4a8114fb1b8e req-858cbe66-d788-40ef-a28f-afdfb3769d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c340b42-3ca5-4f89-8fc2-c448e784ac83", "tag": "afe54511-8f8c-42eb-8ca3-b2337f457222"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:41.729591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:41.729591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:41.742648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-eb24f95b-9e34-41a3-92c5-4a8114fb1b8e req-858cbe66-d788-40ef-a28f-afdfb3769d6d service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:41.743468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-eb24f95b-9e34-41a3-92c5-4a8114fb1b8e req-858cbe66-d788-40ef-a28f-afdfb3769d6d service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:41.748703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-61aeb4a9-3505-4f90-94e7-bb20c4e172e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.195640 Dec 03 15:07:41.749638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 328/669] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:41 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:41.762360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5415081d-9508-4b42-ab9c-16a5f5b2aff7 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '.version_select at 0x7fd5f69e4510>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:41.767887 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-eb24f95b-9e34-41a3-92c5-4a8114fb1b8e req-858cbe66-d788-40ef-a28f-afdfb3769d6d service nova] Creating event network-changed:afe54511-8f8c-42eb-8ca3-b2337f457222 for instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 on hv-cinder-75790 Dec 03 15:07:41.778184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-eb24f95b-9e34-41a3-92c5-4a8114fb1b8e req-858cbe66-d788-40ef-a28f-afdfb3769d6d service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067815 Dec 03 15:07:41.779095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 342/670] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:41 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:41.955539 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b5a4015c-9004-4cab-a6a0-b6bce485f061 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:41.956307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b5a4015c-9004-4cab-a6a0-b6bce485f061 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:41.965664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5a4015c-9004-4cab-a6a0-b6bce485f061 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:41.966198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5a4015c-9004-4cab-a6a0-b6bce485f061 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:41.967029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5a4015c-9004-4cab-a6a0-b6bce485f061 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:41.967716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5a4015c-9004-4cab-a6a0-b6bce485f061 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:42.113530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b5a4015c-9004-4cab-a6a0-b6bce485f061 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:42.125188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b5a4015c-9004-4cab-a6a0-b6bce485f061 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1269 microversion: 2.1 time: 0.179891 Dec 03 15:07:42.125784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 343/671] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:41 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:42.537949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7fc3cdb6-4bef-4f75-82b7-e5e6d567dff9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:42.538492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7fc3cdb6-4bef-4f75-82b7-e5e6d567dff9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:42.561631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7fc3cdb6-4bef-4f75-82b7-e5e6d567dff9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:42.566196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7fc3cdb6-4bef-4f75-82b7-e5e6d567dff9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:42.572511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7fc3cdb6-4bef-4f75-82b7-e5e6d567dff9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:42.573246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7fc3cdb6-4bef-4f75-82b7-e5e6d567dff9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:42.991340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7fc3cdb6-4bef-4f75-82b7-e5e6d567dff9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:43.002258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7fc3cdb6-4bef-4f75-82b7-e5e6d567dff9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1364 microversion: 2.1 time: 0.473870 Dec 03 15:07:43.003228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 344/672] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:42 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1364 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:43.021668 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-26ce82fa-7fe5-40ee-ae04-ef1169c4c7e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:43.023090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-26ce82fa-7fe5-40ee-ae04-ef1169c4c7e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:43.032326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-26ce82fa-7fe5-40ee-ae04-ef1169c4c7e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:43.033091 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-26ce82fa-7fe5-40ee-ae04-ef1169c4c7e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:43.034215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-26ce82fa-7fe5-40ee-ae04-ef1169c4c7e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:43.034925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-26ce82fa-7fe5-40ee-ae04-ef1169c4c7e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:43.058556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5415081d-9508-4b42-ab9c-16a5f5b2aff7 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "DELETE /compute/v2.1/os-security-groups/5ffdf135-388f-48b5-bce4-3a1c9059bc68" status: 202 len: 0 microversion: 2.1 time: 1.307192 Dec 03 15:07:43.060088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 329/673] 10.222.0.63 () {58 vars in 1262 bytes} [Thu Dec 3 15:07:41 2020] DELETE /compute/v2.1/os-security-groups/5ffdf135-388f-48b5-bce4-3a1c9059bc68 => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:43.077067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '.version_select at 0x7fd5f69e4840>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:43.198290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-26ce82fa-7fe5-40ee-ae04-ef1169c4c7e7 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 14 microversion: 2.20 time: 0.192685 Dec 03 15:07:43.199287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 345/674] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:43 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:43.212117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-35fe311d-60da-4c21-86ea-204eac9ba205 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:43.213927 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-35fe311d-60da-4c21-86ea-204eac9ba205 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:43.222593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-35fe311d-60da-4c21-86ea-204eac9ba205 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:43.223439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-35fe311d-60da-4c21-86ea-204eac9ba205 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:43.224397 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-35fe311d-60da-4c21-86ea-204eac9ba205 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:43.225206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-35fe311d-60da-4c21-86ea-204eac9ba205 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:43.419877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-35fe311d-60da-4c21-86ea-204eac9ba205 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:43.430007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-35fe311d-60da-4c21-86ea-204eac9ba205 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1275 microversion: 2.1 time: 0.229092 Dec 03 15:07:43.431217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 346/675] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:43 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:44.141284 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-29fc8308-122c-41a8-882f-828d85219d1e req-a6d790cc-8266-4b5d-a944-d4c1f03db392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dd50c1-fa7d-4a82-8f53-f9cd544b4293", "tag": "b56e789b-5833-4289-8ccf-0c42d598a9bf"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:44.150849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:44.150849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:44.162216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-29fc8308-122c-41a8-882f-828d85219d1e req-a6d790cc-8266-4b5d-a944-d4c1f03db392 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.163173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-29fc8308-122c-41a8-882f-828d85219d1e req-a6d790cc-8266-4b5d-a944-d4c1f03db392 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:44.186107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-29fc8308-122c-41a8-882f-828d85219d1e req-a6d790cc-8266-4b5d-a944-d4c1f03db392 service nova] Creating event network-changed:b56e789b-5833-4289-8ccf-0c42d598a9bf for instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 on hv-cinder-75790 Dec 03 15:07:44.192735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-29fc8308-122c-41a8-882f-828d85219d1e req-a6d790cc-8266-4b5d-a944-d4c1f03db392 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180127 Dec 03 15:07:44.194330 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 347/676] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:44 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:44.207702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b2880d13-f048-4fea-8f68-8106c0865c74 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:44.208626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b2880d13-f048-4fea-8f68-8106c0865c74 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:44.218354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2880d13-f048-4fea-8f68-8106c0865c74 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.218886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2880d13-f048-4fea-8f68-8106c0865c74 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:44.219729 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2880d13-f048-4fea-8f68-8106c0865c74 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.220207 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2880d13-f048-4fea-8f68-8106c0865c74 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:44.307698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:44.318284 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.319183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:44.320185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.320908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:44.388797 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Acquired lock "refresh_cache-0c340b42-3ca5-4f89-8fc2-c448e784ac83" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:07:44.640026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b2880d13-f048-4fea-8f68-8106c0865c74 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:44.649265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b2880d13-f048-4fea-8f68-8106c0865c74 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1364 microversion: 2.1 time: 0.453184 Dec 03 15:07:44.650830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 348/677] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:44 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1364 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:44.661359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6c124155-29cd-4cb0-9bbd-87308a499c13 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:44.662592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6c124155-29cd-4cb0-9bbd-87308a499c13 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:44.670731 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c124155-29cd-4cb0-9bbd-87308a499c13 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.671388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c124155-29cd-4cb0-9bbd-87308a499c13 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:44.672240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c124155-29cd-4cb0-9bbd-87308a499c13 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.672736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c124155-29cd-4cb0-9bbd-87308a499c13 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:44.845452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6c124155-29cd-4cb0-9bbd-87308a499c13 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 10658 microversion: 2.20 time: 0.193293 Dec 03 15:07:44.846788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 349/678] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:44 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 10658 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:44.862369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ec02d37f-6aed-4386-a614-41ef9a6bfe2a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:44.863159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ec02d37f-6aed-4386-a614-41ef9a6bfe2a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:44.873445 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ec02d37f-6aed-4386-a614-41ef9a6bfe2a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.873873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ec02d37f-6aed-4386-a614-41ef9a6bfe2a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:44.875207 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ec02d37f-6aed-4386-a614-41ef9a6bfe2a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:44.875711 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ec02d37f-6aed-4386-a614-41ef9a6bfe2a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:45.430975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ec02d37f-6aed-4386-a614-41ef9a6bfe2a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:45.442558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ec02d37f-6aed-4386-a614-41ef9a6bfe2a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1317 microversion: 2.1 time: 0.590966 Dec 03 15:07:45.454748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 350/679] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:44 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:45.674681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e7d86cb6-b296-49c7-91a6-8c27fc40fe4b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:45.675521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e7d86cb6-b296-49c7-91a6-8c27fc40fe4b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:45.685817 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e7d86cb6-b296-49c7-91a6-8c27fc40fe4b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:45.686456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e7d86cb6-b296-49c7-91a6-8c27fc40fe4b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:45.687591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e7d86cb6-b296-49c7-91a6-8c27fc40fe4b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:45.688092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e7d86cb6-b296-49c7-91a6-8c27fc40fe4b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:46.143523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e7d86cb6-b296-49c7-91a6-8c27fc40fe4b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:46.155388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e7d86cb6-b296-49c7-91a6-8c27fc40fe4b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1364 microversion: 2.1 time: 0.491327 Dec 03 15:07:46.156190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 351/680] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:45 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1364 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:46.176387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-0c0bc55e-1eb2-4366-83b1-a6dd74153d9b req-9d389071-ddc2-4e3a-b2b1-c229335bc777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3408aa8b-4b63-4c7c-afd8-a7a1f236b712", "tag": "d5915ce7-a94b-4748-b261-7ba6236967af"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:46.183609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:46.183609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:46.194113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-0c0bc55e-1eb2-4366-83b1-a6dd74153d9b req-9d389071-ddc2-4e3a-b2b1-c229335bc777 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:46.194629 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-0c0bc55e-1eb2-4366-83b1-a6dd74153d9b req-9d389071-ddc2-4e3a-b2b1-c229335bc777 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:46.213591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-0c0bc55e-1eb2-4366-83b1-a6dd74153d9b req-9d389071-ddc2-4e3a-b2b1-c229335bc777 service nova] Creating event network-changed:d5915ce7-a94b-4748-b261-7ba6236967af for instance 3408aa8b-4b63-4c7c-afd8-a7a1f236b712 on hv-cinder-75790 Dec 03 15:07:46.218633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-0c0bc55e-1eb2-4366-83b1-a6dd74153d9b req-9d389071-ddc2-4e3a-b2b1-c229335bc777 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051804 Dec 03 15:07:46.219303 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 352/681] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:46 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:46.316046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f75155da-e275-43ae-b5ac-1cb02369166e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:46.317278 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f75155da-e275-43ae-b5ac-1cb02369166e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:46.326509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f75155da-e275-43ae-b5ac-1cb02369166e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:46.327018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f75155da-e275-43ae-b5ac-1cb02369166e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:46.327914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f75155da-e275-43ae-b5ac-1cb02369166e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:46.328374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f75155da-e275-43ae-b5ac-1cb02369166e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:46.469614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f75155da-e275-43ae-b5ac-1cb02369166e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 17914 microversion: 2.20 time: 0.248588 Dec 03 15:07:46.470307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 353/682] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:46 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 17914 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:46.482234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-955d0f3c-0908-46a4-9929-0d1a5e1d6047 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:46.483134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-955d0f3c-0908-46a4-9929-0d1a5e1d6047 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:46.491520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-955d0f3c-0908-46a4-9929-0d1a5e1d6047 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:46.492030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-955d0f3c-0908-46a4-9929-0d1a5e1d6047 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:46.492915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-955d0f3c-0908-46a4-9929-0d1a5e1d6047 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:46.493431 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-955d0f3c-0908-46a4-9929-0d1a5e1d6047 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:46.784078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-955d0f3c-0908-46a4-9929-0d1a5e1d6047 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:46.803228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-955d0f3c-0908-46a4-9929-0d1a5e1d6047 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1317 microversion: 2.1 time: 0.331524 Dec 03 15:07:46.804863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 354/683] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:46 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:47.178549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ab3a5705-8974-4253-901a-5f6efbf89439 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:47.179357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ab3a5705-8974-4253-901a-5f6efbf89439 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:47.188021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ab3a5705-8974-4253-901a-5f6efbf89439 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:47.188524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ab3a5705-8974-4253-901a-5f6efbf89439 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:47.189386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ab3a5705-8974-4253-901a-5f6efbf89439 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:47.189878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ab3a5705-8974-4253-901a-5f6efbf89439 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:47.616068 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ab3a5705-8974-4253-901a-5f6efbf89439 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:47.629457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ab3a5705-8974-4253-901a-5f6efbf89439 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1364 microversion: 2.1 time: 0.459827 Dec 03 15:07:47.630157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 355/684] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:47 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:47.641973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f4cd9408-cfb8-4520-81dd-edc5373d1faf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:47.643121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f4cd9408-cfb8-4520-81dd-edc5373d1faf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:47.652460 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f4cd9408-cfb8-4520-81dd-edc5373d1faf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:47.652963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f4cd9408-cfb8-4520-81dd-edc5373d1faf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:47.653941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f4cd9408-cfb8-4520-81dd-edc5373d1faf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:47.654321 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f4cd9408-cfb8-4520-81dd-edc5373d1faf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:47.715960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Building network info cache for instance {{(pid=94373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:07:47.831849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f4cd9408-cfb8-4520-81dd-edc5373d1faf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 19342 microversion: 2.20 time: 0.200274 Dec 03 15:07:47.833336 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 356/685] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:47 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 19342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:47.846307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-70c5285e-4985-4895-8f76-320e0608c7d4 req-39133329-7c0c-4bb5-ab91-b89550dd6795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c340b42-3ca5-4f89-8fc2-c448e784ac83", "tag": "afe54511-8f8c-42eb-8ca3-b2337f457222"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:47.854223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:47.854223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:47.864012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-70c5285e-4985-4895-8f76-320e0608c7d4 req-39133329-7c0c-4bb5-ab91-b89550dd6795 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:47.864539 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-70c5285e-4985-4895-8f76-320e0608c7d4 req-39133329-7c0c-4bb5-ab91-b89550dd6795 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:47.884080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-70c5285e-4985-4895-8f76-320e0608c7d4 req-39133329-7c0c-4bb5-ab91-b89550dd6795 service nova] Creating event network-changed:afe54511-8f8c-42eb-8ca3-b2337f457222 for instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 on hv-cinder-75790 Dec 03 15:07:47.889509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-70c5285e-4985-4895-8f76-320e0608c7d4 req-39133329-7c0c-4bb5-ab91-b89550dd6795 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055295 Dec 03 15:07:47.890362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 357/686] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:47 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:47.901798 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4f78c644-47dd-4292-919d-a9be259b272d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:47.902613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4f78c644-47dd-4292-919d-a9be259b272d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:47.910942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f78c644-47dd-4292-919d-a9be259b272d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:47.911461 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f78c644-47dd-4292-919d-a9be259b272d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:47.912334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f78c644-47dd-4292-919d-a9be259b272d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:47.912948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f78c644-47dd-4292-919d-a9be259b272d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:48.150815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4f78c644-47dd-4292-919d-a9be259b272d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:48.162600 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4f78c644-47dd-4292-919d-a9be259b272d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1317 microversion: 2.1 time: 0.271018 Dec 03 15:07:48.163956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 358/687] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:47 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:48.653969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ed9f21c9-3872-4fa5-99b2-f97f703eb2c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:48.654638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ed9f21c9-3872-4fa5-99b2-f97f703eb2c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:48.662867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed9f21c9-3872-4fa5-99b2-f97f703eb2c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:48.663374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed9f21c9-3872-4fa5-99b2-f97f703eb2c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:48.664224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed9f21c9-3872-4fa5-99b2-f97f703eb2c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:48.664712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed9f21c9-3872-4fa5-99b2-f97f703eb2c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:48.913037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ed9f21c9-3872-4fa5-99b2-f97f703eb2c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:48.927869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ed9f21c9-3872-4fa5-99b2-f97f703eb2c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1364 microversion: 2.1 time: 0.283420 Dec 03 15:07:48.928652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 359/688] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:48 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:48.940014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-823ca4a3-5979-4624-b2d6-7b9f48b27afd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:48.941066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-823ca4a3-5979-4624-b2d6-7b9f48b27afd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:48.950898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-823ca4a3-5979-4624-b2d6-7b9f48b27afd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:48.951331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-823ca4a3-5979-4624-b2d6-7b9f48b27afd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:48.952199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-823ca4a3-5979-4624-b2d6-7b9f48b27afd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:48.952692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-823ca4a3-5979-4624-b2d6-7b9f48b27afd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:49.071183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Updating instance_info_cache with network_info: [{"id": "afe54511-8f8c-42eb-8ca3-b2337f457222", "address": "fa:16:3e:2f:ec:69", "network": {"id": "52cd6ebc-32b4-40f6-9b98-6760dd6218f7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-88033544-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26c9d45e8fe5417f944a2053d351ef69", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapafe54511-8f", "ovs_interfaceid": "afe54511-8f8c-42eb-8ca3-b2337f457222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:07:49.091224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Releasing lock "refresh_cache-0c340b42-3ca5-4f89-8fc2-c448e784ac83" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:07:49.092272 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1c981f88-42f6-4c3e-bb4a-e505a2f6e655 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "DELETE /compute/v2.1/os-floating-ips/53fd5534-3c66-431f-b5ac-c8d3c200f028" status: 202 len: 0 microversion: 2.1 time: 6.026084 Dec 03 15:07:49.093170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 330/689] 10.222.0.63 () {58 vars in 1253 bytes} [Thu Dec 3 15:07:43 2020] DELETE /compute/v2.1/os-floating-ips/53fd5534-3c66-431f-b5ac-c8d3c200f028 => generated 0 bytes in 6027 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:07:49.107843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-091f23a8-149a-4e7a-989d-199d74fb9bcd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:49.108402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-091f23a8-149a-4e7a-989d-199d74fb9bcd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:49.114187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-823ca4a3-5979-4624-b2d6-7b9f48b27afd tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 21513 microversion: 2.20 time: 0.184043 Dec 03 15:07:49.115546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 360/690] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:48 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 21513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:49.122085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-091f23a8-149a-4e7a-989d-199d74fb9bcd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:49.122605 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-091f23a8-149a-4e7a-989d-199d74fb9bcd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:49.123444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-091f23a8-149a-4e7a-989d-199d74fb9bcd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:49.124102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-091f23a8-149a-4e7a-989d-199d74fb9bcd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:49.189316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7a474039-9078-48d5-bb57-ce7073c17091 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:49.189779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7a474039-9078-48d5-bb57-ce7073c17091 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:49.199647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a474039-9078-48d5-bb57-ce7073c17091 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:49.200161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a474039-9078-48d5-bb57-ce7073c17091 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:49.201102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a474039-9078-48d5-bb57-ce7073c17091 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:49.201545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a474039-9078-48d5-bb57-ce7073c17091 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:49.442987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-091f23a8-149a-4e7a-989d-199d74fb9bcd tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "DELETE /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/os-volume_attachments/0d6efc0c-ce7b-417c-81ce-40a192f775d3" status: 202 len: 0 microversion: 2.1 time: 0.344691 Dec 03 15:07:49.443740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 331/691] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:07:49 2020] DELETE /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/os-volume_attachments/0d6efc0c-ce7b-417c-81ce-40a192f775d3 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:07:49.495984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7a474039-9078-48d5-bb57-ce7073c17091 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:49.505451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7a474039-9078-48d5-bb57-ce7073c17091 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1317 microversion: 2.1 time: 0.327098 Dec 03 15:07:49.506122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 361/692] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:49 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:07:49.827066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-4bb5c808-3b4e-4c95-9ee7-5cb070e3f514 req-bb1c2685-d23c-4d85-866d-571125a56f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dd50c1-fa7d-4a82-8f53-f9cd544b4293", "name": "network-vif-plugged", "status": "completed", "tag": "b56e789b-5833-4289-8ccf-0c42d598a9bf"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:49.833489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:49.833489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:49.843499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-4bb5c808-3b4e-4c95-9ee7-5cb070e3f514 req-bb1c2685-d23c-4d85-866d-571125a56f0d service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:49.844011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-4bb5c808-3b4e-4c95-9ee7-5cb070e3f514 req-bb1c2685-d23c-4d85-866d-571125a56f0d service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:49.865246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-4bb5c808-3b4e-4c95-9ee7-5cb070e3f514 req-bb1c2685-d23c-4d85-866d-571125a56f0d service nova] Creating event network-vif-plugged:b56e789b-5833-4289-8ccf-0c42d598a9bf for instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 on hv-cinder-75790 Dec 03 15:07:49.871888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-4bb5c808-3b4e-4c95-9ee7-5cb070e3f514 req-bb1c2685-d23c-4d85-866d-571125a56f0d service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148240 Dec 03 15:07:49.872828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 332/693] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:49 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:49.953240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fb8b1244-c34a-4d2f-8287-3bad64978291 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:49.954124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fb8b1244-c34a-4d2f-8287-3bad64978291 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:49.961991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fb8b1244-c34a-4d2f-8287-3bad64978291 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:49.962744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fb8b1244-c34a-4d2f-8287-3bad64978291 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:49.964115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fb8b1244-c34a-4d2f-8287-3bad64978291 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:49.964607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fb8b1244-c34a-4d2f-8287-3bad64978291 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:50.134408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a1237ce0-578f-4b47-bba4-b41daf4c6311 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:50.135913 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a1237ce0-578f-4b47-bba4-b41daf4c6311 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:50.146104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1237ce0-578f-4b47-bba4-b41daf4c6311 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:50.146624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1237ce0-578f-4b47-bba4-b41daf4c6311 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:50.147495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1237ce0-578f-4b47-bba4-b41daf4c6311 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:50.148259 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1237ce0-578f-4b47-bba4-b41daf4c6311 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:50.213185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fb8b1244-c34a-4d2f-8287-3bad64978291 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:50.226944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fb8b1244-c34a-4d2f-8287-3bad64978291 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1364 microversion: 2.1 time: 0.283219 Dec 03 15:07:50.227772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 362/694] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:49 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:50.327519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a1237ce0-578f-4b47-bba4-b41daf4c6311 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 22888 microversion: 2.20 time: 0.202955 Dec 03 15:07:50.328376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 333/695] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:50 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 22888 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:50.533209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8deab4aa-a381-4567-912f-2fa4591aee2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:50.533945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8deab4aa-a381-4567-912f-2fa4591aee2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:50.542564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8deab4aa-a381-4567-912f-2fa4591aee2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:50.543064 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8deab4aa-a381-4567-912f-2fa4591aee2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:50.543902 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8deab4aa-a381-4567-912f-2fa4591aee2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:50.544390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8deab4aa-a381-4567-912f-2fa4591aee2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:50.772016 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8deab4aa-a381-4567-912f-2fa4591aee2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:50.781670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8deab4aa-a381-4567-912f-2fa4591aee2b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1317 microversion: 2.1 time: 0.257666 Dec 03 15:07:50.782301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 363/696] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:50 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:51.253291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e2b0a452-6f78-4b96-95f3-91378b816ce9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:51.254173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e2b0a452-6f78-4b96-95f3-91378b816ce9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:51.263842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e2b0a452-6f78-4b96-95f3-91378b816ce9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:51.264350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e2b0a452-6f78-4b96-95f3-91378b816ce9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:51.265185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e2b0a452-6f78-4b96-95f3-91378b816ce9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:51.265746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e2b0a452-6f78-4b96-95f3-91378b816ce9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:51.345583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ff52d901-0395-452c-b7f7-0402396f8ab9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:51.346864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ff52d901-0395-452c-b7f7-0402396f8ab9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:51.356019 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff52d901-0395-452c-b7f7-0402396f8ab9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:51.356515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff52d901-0395-452c-b7f7-0402396f8ab9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:51.357362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff52d901-0395-452c-b7f7-0402396f8ab9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:51.357846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ff52d901-0395-452c-b7f7-0402396f8ab9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:51.497407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e2b0a452-6f78-4b96-95f3-91378b816ce9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:51.506437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e2b0a452-6f78-4b96-95f3-91378b816ce9 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1364 microversion: 2.1 time: 0.263959 Dec 03 15:07:51.506965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 334/697] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:51 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:51.520369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ff52d901-0395-452c-b7f7-0402396f8ab9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 23794 microversion: 2.20 time: 0.184055 Dec 03 15:07:51.521280 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 364/698] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:51 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 23794 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:07:51.808897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9205f4bb-3160-473f-bf75-393322b5cfdf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:51.809589 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9205f4bb-3160-473f-bf75-393322b5cfdf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:51.824217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9205f4bb-3160-473f-bf75-393322b5cfdf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:51.824826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9205f4bb-3160-473f-bf75-393322b5cfdf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:51.825581 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9205f4bb-3160-473f-bf75-393322b5cfdf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:51.826113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9205f4bb-3160-473f-bf75-393322b5cfdf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:51.912709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:51.913365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:51.923529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:51.924104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:51.924964 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:51.925431 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:52.067439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9205f4bb-3160-473f-bf75-393322b5cfdf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:52.079806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9205f4bb-3160-473f-bf75-393322b5cfdf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1317 microversion: 2.1 time: 0.282934 Dec 03 15:07:52.080772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 335/699] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:51 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:52.093649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-0ad83e76-ae16-4832-b956-82151aff65c9 req-34afff28-6685-499b-82e2-221429fe2d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3408aa8b-4b63-4c7c-afd8-a7a1f236b712", "name": "network-vif-plugged", "status": "completed", "tag": "d5915ce7-a94b-4748-b261-7ba6236967af"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:52.101627 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:52.101627 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:52.112259 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-0ad83e76-ae16-4832-b956-82151aff65c9 req-34afff28-6685-499b-82e2-221429fe2d29 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:52.112797 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-0ad83e76-ae16-4832-b956-82151aff65c9 req-34afff28-6685-499b-82e2-221429fe2d29 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:52.114289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] HTTP exception thrown: Instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 is not attached to volume 0d6efc0c-ce7b-417c-81ce-40a192f775d3 Dec 03 15:07:52.115059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Returning 404 to user: Instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 is not attached to volume 0d6efc0c-ce7b-417c-81ce-40a192f775d3 {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:07:52.116072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3193acf9-28d4-4551-b8ea-7e3f9be96b27 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "DELETE /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/os-volume_attachments/0d6efc0c-ce7b-417c-81ce-40a192f775d3" status: 404 len: 154 microversion: 2.1 time: 0.214002 Dec 03 15:07:52.117063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 365/700] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:07:51 2020] DELETE /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83/os-volume_attachments/0d6efc0c-ce7b-417c-81ce-40a192f775d3 => generated 154 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:07:52.133415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-0ad83e76-ae16-4832-b956-82151aff65c9 req-34afff28-6685-499b-82e2-221429fe2d29 service nova] Creating event network-vif-plugged:d5915ce7-a94b-4748-b261-7ba6236967af for instance 3408aa8b-4b63-4c7c-afd8-a7a1f236b712 on hv-cinder-75790 Dec 03 15:07:52.139365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-0ad83e76-ae16-4832-b956-82151aff65c9 req-34afff28-6685-499b-82e2-221429fe2d29 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057279 Dec 03 15:07:52.140022 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 336/701] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:52 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:52.529866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1695a684-556a-4368-b211-d31519870eea tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:52.530571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1695a684-556a-4368-b211-d31519870eea tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:52.538551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1695a684-556a-4368-b211-d31519870eea tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:52.539062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1695a684-556a-4368-b211-d31519870eea tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:52.539229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4c4256b7-bec2-4874-bfb4-9a52b55c7377 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:52.539913 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1695a684-556a-4368-b211-d31519870eea tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:52.540422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4c4256b7-bec2-4874-bfb4-9a52b55c7377 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:52.541230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1695a684-556a-4368-b211-d31519870eea tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:52.549156 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4c4256b7-bec2-4874-bfb4-9a52b55c7377 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:52.549587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4c4256b7-bec2-4874-bfb4-9a52b55c7377 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:52.550447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4c4256b7-bec2-4874-bfb4-9a52b55c7377 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:52.550935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4c4256b7-bec2-4874-bfb4-9a52b55c7377 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:52.774132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1695a684-556a-4368-b211-d31519870eea tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:52.783326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1695a684-556a-4368-b211-d31519870eea tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1551 microversion: 2.1 time: 0.263511 Dec 03 15:07:52.783926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 366/702] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:52 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1551 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:52.807158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8b724846-fb59-4f04-916a-b4f368a05d71 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:52.807640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8b724846-fb59-4f04-916a-b4f368a05d71 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:52.815607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b724846-fb59-4f04-916a-b4f368a05d71 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:52.816119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b724846-fb59-4f04-916a-b4f368a05d71 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:52.816973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b724846-fb59-4f04-916a-b4f368a05d71 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:52.817522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b724846-fb59-4f04-916a-b4f368a05d71 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:52.913610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4c4256b7-bec2-4874-bfb4-9a52b55c7377 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 24866 microversion: 2.20 time: 0.384547 Dec 03 15:07:52.918542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 337/703] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:52 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 24866 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:07:52.986446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8b724846-fb59-4f04-916a-b4f368a05d71 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189182 Dec 03 15:07:52.987117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 367/704] 10.222.0.63 () {58 vars in 1265 bytes} [Thu Dec 3 15:07:52 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:07:53.104767 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c1dbe913-5f8e-4784-bc14-76238b115cbc tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:53.105567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c1dbe913-5f8e-4784-bc14-76238b115cbc tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:53.114847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1dbe913-5f8e-4784-bc14-76238b115cbc tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:53.115369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1dbe913-5f8e-4784-bc14-76238b115cbc tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:53.116268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1dbe913-5f8e-4784-bc14-76238b115cbc tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:53.116777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c1dbe913-5f8e-4784-bc14-76238b115cbc tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:53.365827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c1dbe913-5f8e-4784-bc14-76238b115cbc tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:53.382593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c1dbe913-5f8e-4784-bc14-76238b115cbc tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1317 microversion: 2.1 time: 0.289078 Dec 03 15:07:53.383799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 338/705] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:53 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:53.404996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8357db10-b7bb-4361-8ea9-8ec0f3bc09e6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:53.405556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8357db10-b7bb-4361-8ea9-8ec0f3bc09e6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:53.414015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8357db10-b7bb-4361-8ea9-8ec0f3bc09e6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:53.414625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8357db10-b7bb-4361-8ea9-8ec0f3bc09e6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:53.415845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8357db10-b7bb-4361-8ea9-8ec0f3bc09e6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:53.416324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8357db10-b7bb-4361-8ea9-8ec0f3bc09e6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:53.491881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8357db10-b7bb-4361-8ea9-8ec0f3bc09e6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:07:53.617176 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8357db10-b7bb-4361-8ea9-8ec0f3bc09e6 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "DELETE /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 204 len: 0 microversion: 2.1 time: 0.221423 Dec 03 15:07:53.621708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 368/706] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:07:53 2020] DELETE /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:07:53.633616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ba34685b-154a-4811-a001-aeddd93ed235 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:53.635426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ba34685b-154a-4811-a001-aeddd93ed235 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:53.643638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ba34685b-154a-4811-a001-aeddd93ed235 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:53.644245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ba34685b-154a-4811-a001-aeddd93ed235 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:53.645181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ba34685b-154a-4811-a001-aeddd93ed235 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:53.645755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ba34685b-154a-4811-a001-aeddd93ed235 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:53.908349 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ba34685b-154a-4811-a001-aeddd93ed235 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:53.918241 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ba34685b-154a-4811-a001-aeddd93ed235 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1553 microversion: 2.1 time: 0.295035 Dec 03 15:07:53.929844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 339/707] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:53 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:53.932640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2b6b34ff-d86c-4bcd-99c7-4ec8262d5754 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:53.934009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2b6b34ff-d86c-4bcd-99c7-4ec8262d5754 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:53.941963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b6b34ff-d86c-4bcd-99c7-4ec8262d5754 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:53.942491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b6b34ff-d86c-4bcd-99c7-4ec8262d5754 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:53.943354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b6b34ff-d86c-4bcd-99c7-4ec8262d5754 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:53.943858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b6b34ff-d86c-4bcd-99c7-4ec8262d5754 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:54.154014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2b6b34ff-d86c-4bcd-99c7-4ec8262d5754 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 25820 microversion: 2.20 time: 0.231511 Dec 03 15:07:54.155948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 369/708] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:53 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 25820 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:54.407226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1e5de0a4-b565-490c-8eaf-dde12b80c260 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:54.407817 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1e5de0a4-b565-490c-8eaf-dde12b80c260 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:54.416939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e5de0a4-b565-490c-8eaf-dde12b80c260 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:54.417443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e5de0a4-b565-490c-8eaf-dde12b80c260 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:54.418335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e5de0a4-b565-490c-8eaf-dde12b80c260 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:54.418855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1e5de0a4-b565-490c-8eaf-dde12b80c260 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:54.636915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1e5de0a4-b565-490c-8eaf-dde12b80c260 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:54.659467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1e5de0a4-b565-490c-8eaf-dde12b80c260 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1506 microversion: 2.1 time: 0.262396 Dec 03 15:07:54.660255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 340/709] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:54 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:54.812786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4d943f5e-e533-474f-a72c-34a816e865e0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:54.814149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4d943f5e-e533-474f-a72c-34a816e865e0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:54.825220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d943f5e-e533-474f-a72c-34a816e865e0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:54.825850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d943f5e-e533-474f-a72c-34a816e865e0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:54.827057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d943f5e-e533-474f-a72c-34a816e865e0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:54.827745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d943f5e-e533-474f-a72c-34a816e865e0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:54.923127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-77275f8f-eca7-4962-a144-6454c467a1be req-b63df369-3f8b-44e4-afcc-181ac919fd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dd50c1-fa7d-4a82-8f53-f9cd544b4293", "tag": "b56e789b-5833-4289-8ccf-0c42d598a9bf"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:54.931821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:54.931821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:54.940730 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-77275f8f-eca7-4962-a144-6454c467a1be req-b63df369-3f8b-44e4-afcc-181ac919fd05 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:54.941307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-77275f8f-eca7-4962-a144-6454c467a1be req-b63df369-3f8b-44e4-afcc-181ac919fd05 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:54.959598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-77275f8f-eca7-4962-a144-6454c467a1be req-b63df369-3f8b-44e4-afcc-181ac919fd05 service nova] Creating event network-changed:b56e789b-5833-4289-8ccf-0c42d598a9bf for instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 on hv-cinder-75790 Dec 03 15:07:54.965684 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-77275f8f-eca7-4962-a144-6454c467a1be req-b63df369-3f8b-44e4-afcc-181ac919fd05 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149048 Dec 03 15:07:54.966447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 341/710] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:54 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:54.979768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2ed55a66-3819-409b-9896-80123b34731f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:54.980690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2ed55a66-3819-409b-9896-80123b34731f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:54.989389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2ed55a66-3819-409b-9896-80123b34731f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:54.990027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2ed55a66-3819-409b-9896-80123b34731f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:54.991858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2ed55a66-3819-409b-9896-80123b34731f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:54.992442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2ed55a66-3819-409b-9896-80123b34731f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:55.026380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4d943f5e-e533-474f-a72c-34a816e865e0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.228673 Dec 03 15:07:55.027595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 370/711] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:07:54 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:07:55.173790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f5659cf8-43dd-4d0c-acfe-4be1a0022302 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:55.187398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f5659cf8-43dd-4d0c-acfe-4be1a0022302 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:55.196380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f5659cf8-43dd-4d0c-acfe-4be1a0022302 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:55.198517 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f5659cf8-43dd-4d0c-acfe-4be1a0022302 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:55.203093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f5659cf8-43dd-4d0c-acfe-4be1a0022302 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:55.206382 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f5659cf8-43dd-4d0c-acfe-4be1a0022302 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:55.347698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2ed55a66-3819-409b-9896-80123b34731f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:55.358736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2ed55a66-3819-409b-9896-80123b34731f tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1553 microversion: 2.1 time: 0.388962 Dec 03 15:07:55.361454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 342/712] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:54 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:55.386726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f5659cf8-43dd-4d0c-acfe-4be1a0022302 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 26587 microversion: 2.20 time: 0.223804 Dec 03 15:07:55.387434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 371/713] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:55 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 26587 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:56.045458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3cfca87f-ce26-4e06-915c-4d544381d97e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:56.046529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3cfca87f-ce26-4e06-915c-4d544381d97e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:56.054740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3cfca87f-ce26-4e06-915c-4d544381d97e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:56.055253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3cfca87f-ce26-4e06-915c-4d544381d97e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:56.057033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3cfca87f-ce26-4e06-915c-4d544381d97e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:56.057742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3cfca87f-ce26-4e06-915c-4d544381d97e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:56.231409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3cfca87f-ce26-4e06-915c-4d544381d97e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.196314 Dec 03 15:07:56.232282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 343/714] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:07:56 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:07:56.382905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-556f083b-7134-4d68-b383-31d494b26e8c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:56.383696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-556f083b-7134-4d68-b383-31d494b26e8c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:56.394821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-556f083b-7134-4d68-b383-31d494b26e8c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:56.395333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-556f083b-7134-4d68-b383-31d494b26e8c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:56.396193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-556f083b-7134-4d68-b383-31d494b26e8c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:56.396691 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-556f083b-7134-4d68-b383-31d494b26e8c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:56.403167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f829f3de-647c-4f0e-bd4b-7d387c6d8e89 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37b3abd7-3a8c-4770-b43e-8fcbaac59c83"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:56.404486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f829f3de-647c-4f0e-bd4b-7d387c6d8e89 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:56.414658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f829f3de-647c-4f0e-bd4b-7d387c6d8e89 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:56.416293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f829f3de-647c-4f0e-bd4b-7d387c6d8e89 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:56.417407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f829f3de-647c-4f0e-bd4b-7d387c6d8e89 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:56.418167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f829f3de-647c-4f0e-bd4b-7d387c6d8e89 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:56.635497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-556f083b-7134-4d68-b383-31d494b26e8c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:56.644794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-556f083b-7134-4d68-b383-31d494b26e8c tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1553 microversion: 2.1 time: 0.271672 Dec 03 15:07:56.658007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 372/715] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:56 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:56.669561 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c31d80e2-3b7e-4bfe-b681-8a74587762e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:56.670648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c31d80e2-3b7e-4bfe-b681-8a74587762e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:56.679180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c31d80e2-3b7e-4bfe-b681-8a74587762e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:56.679686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c31d80e2-3b7e-4bfe-b681-8a74587762e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:56.680543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c31d80e2-3b7e-4bfe-b681-8a74587762e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:56.681967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c31d80e2-3b7e-4bfe-b681-8a74587762e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:56.843250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c31d80e2-3b7e-4bfe-b681-8a74587762e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 27420 microversion: 2.20 time: 0.183246 Dec 03 15:07:56.843883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 373/716] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:56 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 27420 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:56.892567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f829f3de-647c-4f0e-bd4b-7d387c6d8e89 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "POST /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500116 Dec 03 15:07:56.893329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 344/717] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:07:56 2020] POST /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:57.250286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f12fe7fc-99f6-421a-95f1-350f03b562fd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:57.251549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f12fe7fc-99f6-421a-95f1-350f03b562fd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:57.261579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f12fe7fc-99f6-421a-95f1-350f03b562fd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:57.262178 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f12fe7fc-99f6-421a-95f1-350f03b562fd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:57.263240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f12fe7fc-99f6-421a-95f1-350f03b562fd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:57.263804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f12fe7fc-99f6-421a-95f1-350f03b562fd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:57.417271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f12fe7fc-99f6-421a-95f1-350f03b562fd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.177219 Dec 03 15:07:57.420770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 374/718] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:07:57 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:07:57.572147 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-6159c489-54ae-426d-9c8e-68ab02428028 req-cdf2b8ec-4196-40e0-9c50-858b67443999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c340b42-3ca5-4f89-8fc2-c448e784ac83", "name": "network-vif-deleted", "tag": "afe54511-8f8c-42eb-8ca3-b2337f457222"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:57.579257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:07:57.579257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:07:57.592880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-6159c489-54ae-426d-9c8e-68ab02428028 req-cdf2b8ec-4196-40e0-9c50-858b67443999 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:57.593380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-6159c489-54ae-426d-9c8e-68ab02428028 req-cdf2b8ec-4196-40e0-9c50-858b67443999 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:57.610749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-6159c489-54ae-426d-9c8e-68ab02428028 req-cdf2b8ec-4196-40e0-9c50-858b67443999 service nova] Creating event network-vif-deleted:afe54511-8f8c-42eb-8ca3-b2337f457222 for instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 on hv-cinder-75790 Dec 03 15:07:57.615508 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-6159c489-54ae-426d-9c8e-68ab02428028 req-cdf2b8ec-4196-40e0-9c50-858b67443999 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061259 Dec 03 15:07:57.616167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 345/719] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:07:57 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:07:57.669977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:57.670653 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:57.679802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:57.680322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:57.682288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:57.682828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:57.768061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:57.768573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:57.769091 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lazy-loading 'fault' on Instance uuid 0c340b42-3ca5-4f89-8fc2-c448e784ac83 {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:07:57.837811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a891786834ee18291b68690c6b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c9d45e8fe5417f944a2053d351ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:07:57.846596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fd937331-25e3-41f1-82c4-a19e6805b94d tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 200 len: 1349 microversion: 2.1 time: 0.186875 Dec 03 15:07:57.847195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 375/720] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:57 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 1349 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:07:57.862550 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3fd8627c-9bae-4f7b-bbf8-3fe1800f3e47 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:57.863696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3fd8627c-9bae-4f7b-bbf8-3fe1800f3e47 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:57.872452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fd8627c-9bae-4f7b-bbf8-3fe1800f3e47 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:57.872954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fd8627c-9bae-4f7b-bbf8-3fe1800f3e47 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:57.873802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fd8627c-9bae-4f7b-bbf8-3fe1800f3e47 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:57.874324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fd8627c-9bae-4f7b-bbf8-3fe1800f3e47 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:58.033209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3fd8627c-9bae-4f7b-bbf8-3fe1800f3e47 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 27788 microversion: 2.20 time: 0.181172 Dec 03 15:07:58.034792 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 346/721] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:57 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 27788 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:58.435813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-21bfb041-74e5-4849-bb89-d70822d01baa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:58.436800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-21bfb041-74e5-4849-bb89-d70822d01baa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:58.444759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21bfb041-74e5-4849-bb89-d70822d01baa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:58.445273 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21bfb041-74e5-4849-bb89-d70822d01baa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:58.446146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21bfb041-74e5-4849-bb89-d70822d01baa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:58.447783 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21bfb041-74e5-4849-bb89-d70822d01baa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:58.596588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-21bfb041-74e5-4849-bb89-d70822d01baa tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.171152 Dec 03 15:07:58.597360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 376/722] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:07:58 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:07:58.871998 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:58.872795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] [instance: 0c340b42-3ca5-4f89-8fc2-c448e784ac83] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:58.882005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:58.882523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:58.883368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:58.883871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:58.937477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] HTTP exception thrown: Instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 could not be found. Dec 03 15:07:58.938173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Returning 404 to user: Instance 0c340b42-3ca5-4f89-8fc2-c448e784ac83 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:07:58.939077 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8cae25c7-b573-4482-bc1d-ca48984512e4 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83" status: 404 len: 111 microversion: 2.1 time: 0.077998 Dec 03 15:07:58.939683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 347/723] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:07:58 2020] GET /compute/v2.1/servers/0c340b42-3ca5-4f89-8fc2-c448e784ac83 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:07:58.956267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-47745339-fd83-4055-b979-b22f80b54358 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] Calling method '.version_select at 0x7fd5f61b3e18>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:07:58.978773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-47745339-fd83-4055-b979-b22f80b54358 tempest-TestMinimumBasicScenario-742783596 tempest-TestMinimumBasicScenario-742783596] 10.222.0.63 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1451647261" status: 202 len: 0 microversion: 2.1 time: 0.033520 Dec 03 15:07:58.979389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 377/724] 10.222.0.63 () {58 vars in 1262 bytes} [Thu Dec 3 15:07:58 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1451647261 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:59.050395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cc5cac46-36f5-4337-85dc-6311053604df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:59.051451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cc5cac46-36f5-4337-85dc-6311053604df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:59.059859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cc5cac46-36f5-4337-85dc-6311053604df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:59.060367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cc5cac46-36f5-4337-85dc-6311053604df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:59.061296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cc5cac46-36f5-4337-85dc-6311053604df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:59.061720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cc5cac46-36f5-4337-85dc-6311053604df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:59.229808 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cc5cac46-36f5-4337-85dc-6311053604df tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 28156 microversion: 2.20 time: 0.188368 Dec 03 15:07:59.230663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 348/725] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:07:59 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 28156 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:07:59.615447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3f0d778b-4313-4570-8e5b-e7eaef471d2e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:07:59.616680 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3f0d778b-4313-4570-8e5b-e7eaef471d2e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:07:59.627014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f0d778b-4313-4570-8e5b-e7eaef471d2e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:59.627576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f0d778b-4313-4570-8e5b-e7eaef471d2e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:59.628492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f0d778b-4313-4570-8e5b-e7eaef471d2e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:07:59.629065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3f0d778b-4313-4570-8e5b-e7eaef471d2e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:07:59.792518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3f0d778b-4313-4570-8e5b-e7eaef471d2e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.186904 Dec 03 15:07:59.796328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 378/726] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:07:59 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 03 15:08:00.250287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b3abf209-c31d-4095-84a8-22b0d9a13a9f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:00.251471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b3abf209-c31d-4095-84a8-22b0d9a13a9f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:00.262646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b3abf209-c31d-4095-84a8-22b0d9a13a9f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:00.263160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b3abf209-c31d-4095-84a8-22b0d9a13a9f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:00.264042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b3abf209-c31d-4095-84a8-22b0d9a13a9f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:00.264545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b3abf209-c31d-4095-84a8-22b0d9a13a9f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:00.410835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b3abf209-c31d-4095-84a8-22b0d9a13a9f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 28156 microversion: 2.20 time: 0.171847 Dec 03 15:08:00.415107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 349/727] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:00 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 28156 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:00.812504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fc6fb038-81ae-4b90-9be2-3cb92c8d398c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:00.813742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fc6fb038-81ae-4b90-9be2-3cb92c8d398c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:00.824615 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc6fb038-81ae-4b90-9be2-3cb92c8d398c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:00.825120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc6fb038-81ae-4b90-9be2-3cb92c8d398c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:00.826078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc6fb038-81ae-4b90-9be2-3cb92c8d398c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:00.826650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc6fb038-81ae-4b90-9be2-3cb92c8d398c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:00.975850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fc6fb038-81ae-4b90-9be2-3cb92c8d398c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.174474 Dec 03 15:08:00.980238 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 379/728] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:00 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:08:01.431073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9047fce9-970d-4445-9135-98361c358558 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:01.432960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9047fce9-970d-4445-9135-98361c358558 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:01.441948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9047fce9-970d-4445-9135-98361c358558 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:01.442560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9047fce9-970d-4445-9135-98361c358558 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:01.443530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9047fce9-970d-4445-9135-98361c358558 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:01.444081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9047fce9-970d-4445-9135-98361c358558 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:01.594359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9047fce9-970d-4445-9135-98361c358558 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 28447 microversion: 2.20 time: 0.173598 Dec 03 15:08:01.596481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 350/729] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:01 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 28447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:01.996457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f0e0a706-bf33-4f39-84c7-095d905e6cc0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:01.997622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f0e0a706-bf33-4f39-84c7-095d905e6cc0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:02.006712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0e0a706-bf33-4f39-84c7-095d905e6cc0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:02.007266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0e0a706-bf33-4f39-84c7-095d905e6cc0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:02.008087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0e0a706-bf33-4f39-84c7-095d905e6cc0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:02.008583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0e0a706-bf33-4f39-84c7-095d905e6cc0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:02.159004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f0e0a706-bf33-4f39-84c7-095d905e6cc0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.173652 Dec 03 15:08:02.162541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 380/730] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:01 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:08:02.615732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-75e79edd-a113-4d5b-96de-03fc403a4726 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:02.616790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-75e79edd-a113-4d5b-96de-03fc403a4726 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:02.625624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-75e79edd-a113-4d5b-96de-03fc403a4726 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:02.626166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-75e79edd-a113-4d5b-96de-03fc403a4726 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:02.627014 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-75e79edd-a113-4d5b-96de-03fc403a4726 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:02.627503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-75e79edd-a113-4d5b-96de-03fc403a4726 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:02.771816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-75e79edd-a113-4d5b-96de-03fc403a4726 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 28615 microversion: 2.20 time: 0.165881 Dec 03 15:08:02.773377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 351/731] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:02 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 28615 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:03.177047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-38399cbd-655c-4c07-b667-92683c2f4a4c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:03.178257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-38399cbd-655c-4c07-b667-92683c2f4a4c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:03.188375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38399cbd-655c-4c07-b667-92683c2f4a4c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:03.188991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38399cbd-655c-4c07-b667-92683c2f4a4c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:03.189969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38399cbd-655c-4c07-b667-92683c2f4a4c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:03.190711 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38399cbd-655c-4c07-b667-92683c2f4a4c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:03.334312 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-38399cbd-655c-4c07-b667-92683c2f4a4c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.167050 Dec 03 15:08:03.335004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 381/732] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:03 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:08:03.792144 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eb6e19e4-76f9-4c18-a876-adfb0c190611 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:03.793778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-eb6e19e4-76f9-4c18-a876-adfb0c190611 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:03.803635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb6e19e4-76f9-4c18-a876-adfb0c190611 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:03.804365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb6e19e4-76f9-4c18-a876-adfb0c190611 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:03.806373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb6e19e4-76f9-4c18-a876-adfb0c190611 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:03.807106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eb6e19e4-76f9-4c18-a876-adfb0c190611 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:03.960844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eb6e19e4-76f9-4c18-a876-adfb0c190611 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 28615 microversion: 2.20 time: 0.179127 Dec 03 15:08:03.961575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 352/733] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:03 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 28615 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:04.352660 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8b57f1bb-e762-4f76-82b0-30e8208551c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:04.354432 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8b57f1bb-e762-4f76-82b0-30e8208551c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:04.363395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b57f1bb-e762-4f76-82b0-30e8208551c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:04.363908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b57f1bb-e762-4f76-82b0-30e8208551c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:04.364769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b57f1bb-e762-4f76-82b0-30e8208551c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:04.365268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b57f1bb-e762-4f76-82b0-30e8208551c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:04.497847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8b57f1bb-e762-4f76-82b0-30e8208551c7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.154947 Dec 03 15:08:04.498722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 382/734] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:04 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:08:04.980663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-98cc688d-7076-4430-8b3d-4bab9e7bbd70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:04.982445 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-98cc688d-7076-4430-8b3d-4bab9e7bbd70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:05.003873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98cc688d-7076-4430-8b3d-4bab9e7bbd70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:05.004622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98cc688d-7076-4430-8b3d-4bab9e7bbd70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:05.006344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98cc688d-7076-4430-8b3d-4bab9e7bbd70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:05.007034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98cc688d-7076-4430-8b3d-4bab9e7bbd70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:05.007148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1a0e49af-d147-4aca-8394-36093664fa0f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:05.007833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1a0e49af-d147-4aca-8394-36093664fa0f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:05.017425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a0e49af-d147-4aca-8394-36093664fa0f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:05.018067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a0e49af-d147-4aca-8394-36093664fa0f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:05.019027 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a0e49af-d147-4aca-8394-36093664fa0f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:05.019597 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a0e49af-d147-4aca-8394-36093664fa0f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:05.170229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-98cc688d-7076-4430-8b3d-4bab9e7bbd70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 28615 microversion: 2.20 time: 0.199575 Dec 03 15:08:05.171633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 353/735] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:04 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 28615 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:05.309093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1a0e49af-d147-4aca-8394-36093664fa0f tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "DELETE /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712/os-volume_attachments/37b3abd7-3a8c-4770-b43e-8fcbaac59c83" status: 202 len: 0 microversion: 2.1 time: 0.312580 Dec 03 15:08:05.310069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 383/736] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:08:04 2020] DELETE /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712/os-volume_attachments/37b3abd7-3a8c-4770-b43e-8fcbaac59c83 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:08:05.530511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9a9c2d60-d0f5-412b-a11b-0beefac42ba8 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:05.531584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9a9c2d60-d0f5-412b-a11b-0beefac42ba8 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:05.545952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a9c2d60-d0f5-412b-a11b-0beefac42ba8 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:05.546677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a9c2d60-d0f5-412b-a11b-0beefac42ba8 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:05.547531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a9c2d60-d0f5-412b-a11b-0beefac42ba8 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:05.548066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a9c2d60-d0f5-412b-a11b-0beefac42ba8 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:05.701030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9a9c2d60-d0f5-412b-a11b-0beefac42ba8 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.193766 Dec 03 15:08:05.701710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 354/737] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:05 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:08:06.190387 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c4fd97ef-a6bd-46b5-9aa1-077910824e08 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:06.191875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c4fd97ef-a6bd-46b5-9aa1-077910824e08 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:06.200512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c4fd97ef-a6bd-46b5-9aa1-077910824e08 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:06.200996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c4fd97ef-a6bd-46b5-9aa1-077910824e08 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:06.202130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c4fd97ef-a6bd-46b5-9aa1-077910824e08 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:06.202821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c4fd97ef-a6bd-46b5-9aa1-077910824e08 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:06.348225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c4fd97ef-a6bd-46b5-9aa1-077910824e08 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 28615 microversion: 2.20 time: 0.168504 Dec 03 15:08:06.349143 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 384/738] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:06 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 28615 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:06.718980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-95fa0840-54c2-42a9-a820-570a20affd64 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:06.720754 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-95fa0840-54c2-42a9-a820-570a20affd64 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:06.730829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-95fa0840-54c2-42a9-a820-570a20affd64 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:06.731585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-95fa0840-54c2-42a9-a820-570a20affd64 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:06.732444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-95fa0840-54c2-42a9-a820-570a20affd64 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:06.732937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-95fa0840-54c2-42a9-a820-570a20affd64 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:06.889632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-95fa0840-54c2-42a9-a820-570a20affd64 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14 microversion: 2.1 time: 0.180151 Dec 03 15:08:06.890463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 355/739] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:06 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 15:08:07.367751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-78bee743-21f2-4cea-9347-c1aadf7fa260 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:07.368826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-78bee743-21f2-4cea-9347-c1aadf7fa260 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:07.378452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78bee743-21f2-4cea-9347-c1aadf7fa260 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:07.378969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78bee743-21f2-4cea-9347-c1aadf7fa260 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:07.379849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78bee743-21f2-4cea-9347-c1aadf7fa260 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:07.380351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78bee743-21f2-4cea-9347-c1aadf7fa260 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:07.539050 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-78bee743-21f2-4cea-9347-c1aadf7fa260 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 29199 microversion: 2.20 time: 0.181337 Dec 03 15:08:07.539996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 385/740] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:07 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 29199 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:08:07.909651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3529e13c-7330-4d5c-bff2-4e0bd04c1956 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:07.910889 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3529e13c-7330-4d5c-bff2-4e0bd04c1956 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:07.921197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3529e13c-7330-4d5c-bff2-4e0bd04c1956 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:07.921788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3529e13c-7330-4d5c-bff2-4e0bd04c1956 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:07.922763 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3529e13c-7330-4d5c-bff2-4e0bd04c1956 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:07.923319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3529e13c-7330-4d5c-bff2-4e0bd04c1956 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:08.076019 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3529e13c-7330-4d5c-bff2-4e0bd04c1956 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 7120 microversion: 2.1 time: 0.178133 Dec 03 15:08:08.076737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 356/741] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:07 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 7120 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:08.559169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2e812e4d-ea5a-4683-9746-d0788eaf9d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:08.560318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2e812e4d-ea5a-4683-9746-d0788eaf9d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:08.569071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e812e4d-ea5a-4683-9746-d0788eaf9d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:08.569586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e812e4d-ea5a-4683-9746-d0788eaf9d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:08.570469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e812e4d-ea5a-4683-9746-d0788eaf9d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:08.570981 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2e812e4d-ea5a-4683-9746-d0788eaf9d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:08.741586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2e812e4d-ea5a-4683-9746-d0788eaf9d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 30660 microversion: 2.20 time: 0.192951 Dec 03 15:08:08.742319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 386/742] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:08 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 30660 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:08.888101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2c3f7775-1166-47e9-a259-2cf5b21cc87e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:08.888759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2c3f7775-1166-47e9-a259-2cf5b21cc87e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:08.897314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2c3f7775-1166-47e9-a259-2cf5b21cc87e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:08.897821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2c3f7775-1166-47e9-a259-2cf5b21cc87e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:08.898732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2c3f7775-1166-47e9-a259-2cf5b21cc87e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:08.899225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2c3f7775-1166-47e9-a259-2cf5b21cc87e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:08.974235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2c3f7775-1166-47e9-a259-2cf5b21cc87e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:08:09.091669 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2c3f7775-1166-47e9-a259-2cf5b21cc87e tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "DELETE /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 204 len: 0 microversion: 2.1 time: 0.212992 Dec 03 15:08:09.092247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 357/743] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:08:08 2020] DELETE /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:08:09.095710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e12f4ccb-f3ec-4c4d-a965-da36831dc2b0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:09.096928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e12f4ccb-f3ec-4c4d-a965-da36831dc2b0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:09.106129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e12f4ccb-f3ec-4c4d-a965-da36831dc2b0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:09.106531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4f5d8e53-ba2d-4b43-bc3d-c0c92af370b2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:09.106800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e12f4ccb-f3ec-4c4d-a965-da36831dc2b0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:09.107309 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4f5d8e53-ba2d-4b43-bc3d-c0c92af370b2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:09.107806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e12f4ccb-f3ec-4c4d-a965-da36831dc2b0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:09.108372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e12f4ccb-f3ec-4c4d-a965-da36831dc2b0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:09.115114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e53-ba2d-4b43-bc3d-c0c92af370b2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:09.115625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e53-ba2d-4b43-bc3d-c0c92af370b2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:09.116465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e53-ba2d-4b43-bc3d-c0c92af370b2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:09.116955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e53-ba2d-4b43-bc3d-c0c92af370b2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:09.265692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e12f4ccb-f3ec-4c4d-a965-da36831dc2b0 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 14772 microversion: 2.1 time: 0.181227 Dec 03 15:08:09.266682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 387/744] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:09 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 14772 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:09.347272 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4f5d8e53-ba2d-4b43-bc3d-c0c92af370b2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:09.356173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4f5d8e53-ba2d-4b43-bc3d-c0c92af370b2 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1512 microversion: 2.1 time: 0.259437 Dec 03 15:08:09.356775 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 358/745] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:09 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:08:09.761062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c0812323-01e5-4085-bfb2-1a85c4afb6e3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:09.762250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c0812323-01e5-4085-bfb2-1a85c4afb6e3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:09.771049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0812323-01e5-4085-bfb2-1a85c4afb6e3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:09.771558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0812323-01e5-4085-bfb2-1a85c4afb6e3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:09.772411 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0812323-01e5-4085-bfb2-1a85c4afb6e3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:09.772903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c0812323-01e5-4085-bfb2-1a85c4afb6e3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:09.940543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c0812323-01e5-4085-bfb2-1a85c4afb6e3 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 31827 microversion: 2.20 time: 0.189431 Dec 03 15:08:09.941199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 388/746] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:09 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 31827 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:10.283974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1f42ef15-737b-4295-9c29-737f212a9732 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:10.285098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1f42ef15-737b-4295-9c29-737f212a9732 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:10.295053 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f42ef15-737b-4295-9c29-737f212a9732 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:10.295559 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f42ef15-737b-4295-9c29-737f212a9732 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:10.296396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f42ef15-737b-4295-9c29-737f212a9732 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:10.296888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f42ef15-737b-4295-9c29-737f212a9732 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:10.380102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b045fd6b-92a0-480f-8e4e-382f7f945700 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:10.380871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b045fd6b-92a0-480f-8e4e-382f7f945700 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:10.389540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b045fd6b-92a0-480f-8e4e-382f7f945700 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:10.390073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b045fd6b-92a0-480f-8e4e-382f7f945700 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:10.390907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b045fd6b-92a0-480f-8e4e-382f7f945700 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:10.391396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b045fd6b-92a0-480f-8e4e-382f7f945700 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:10.441120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1f42ef15-737b-4295-9c29-737f212a9732 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 17355 microversion: 2.1 time: 0.167058 Dec 03 15:08:10.445406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 359/747] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:10 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 17355 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:10.618134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b045fd6b-92a0-480f-8e4e-382f7f945700 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:10.627150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b045fd6b-92a0-480f-8e4e-382f7f945700 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1512 microversion: 2.1 time: 0.256715 Dec 03 15:08:10.627744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 389/748] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:10 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:08:10.959258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-58ae5af3-ea1f-4459-8c77-4d229ee0f5da tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:10.960334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-58ae5af3-ea1f-4459-8c77-4d229ee0f5da tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:10.969000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-58ae5af3-ea1f-4459-8c77-4d229ee0f5da tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:10.969514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-58ae5af3-ea1f-4459-8c77-4d229ee0f5da tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:10.970384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-58ae5af3-ea1f-4459-8c77-4d229ee0f5da tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:10.970885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-58ae5af3-ea1f-4459-8c77-4d229ee0f5da tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:11.151877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-58ae5af3-ea1f-4459-8c77-4d229ee0f5da tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 32473 microversion: 2.20 time: 0.202339 Dec 03 15:08:11.152595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 360/749] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:10 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 32473 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:11.458328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-353c316e-eecd-4da1-b7dc-e63a3cb3cee7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:11.459373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-353c316e-eecd-4da1-b7dc-e63a3cb3cee7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:11.468346 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-353c316e-eecd-4da1-b7dc-e63a3cb3cee7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:11.468856 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-353c316e-eecd-4da1-b7dc-e63a3cb3cee7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:11.469691 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-353c316e-eecd-4da1-b7dc-e63a3cb3cee7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:11.470240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-353c316e-eecd-4da1-b7dc-e63a3cb3cee7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:11.634877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-353c316e-eecd-4da1-b7dc-e63a3cb3cee7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 18013 microversion: 2.1 time: 0.185430 Dec 03 15:08:11.635666 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 390/750] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:11 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 18013 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:11.651024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f3d55363-8c02-4e3b-a7d2-e36c6cfc6a7a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:11.652997 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f3d55363-8c02-4e3b-a7d2-e36c6cfc6a7a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:11.661807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3d55363-8c02-4e3b-a7d2-e36c6cfc6a7a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:11.662362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3d55363-8c02-4e3b-a7d2-e36c6cfc6a7a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:11.663234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3d55363-8c02-4e3b-a7d2-e36c6cfc6a7a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:11.663734 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f3d55363-8c02-4e3b-a7d2-e36c6cfc6a7a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:12.170210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e21fb193-6c71-42e6-bc68-b6dfad2de0bf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:12.171585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e21fb193-6c71-42e6-bc68-b6dfad2de0bf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:12.180372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e21fb193-6c71-42e6-bc68-b6dfad2de0bf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:12.181144 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e21fb193-6c71-42e6-bc68-b6dfad2de0bf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:12.182055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e21fb193-6c71-42e6-bc68-b6dfad2de0bf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:12.182613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e21fb193-6c71-42e6-bc68-b6dfad2de0bf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:12.235112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f3d55363-8c02-4e3b-a7d2-e36c6cfc6a7a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:12.244752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f3d55363-8c02-4e3b-a7d2-e36c6cfc6a7a tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1512 microversion: 2.1 time: 0.603615 Dec 03 15:08:12.245616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 361/751] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:11 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:12.332306 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e21fb193-6c71-42e6-bc68-b6dfad2de0bf tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 33205 microversion: 2.20 time: 0.171983 Dec 03 15:08:12.335376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 391/752] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:12 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 33205 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:08:12.575579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-010bce30-604a-4a38-a313-0968f605bfe8 req-04abae9b-32af-487a-b262-d7c97e829b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3408aa8b-4b63-4c7c-afd8-a7a1f236b712", "name": "network-vif-deleted", "tag": "d5915ce7-a94b-4748-b261-7ba6236967af"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:12.583123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:08:12.583123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:08:12.593642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-010bce30-604a-4a38-a313-0968f605bfe8 req-04abae9b-32af-487a-b262-d7c97e829b36 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:12.594174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-010bce30-604a-4a38-a313-0968f605bfe8 req-04abae9b-32af-487a-b262-d7c97e829b36 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:12.611855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-010bce30-604a-4a38-a313-0968f605bfe8 req-04abae9b-32af-487a-b262-d7c97e829b36 service nova] Creating event network-vif-deleted:d5915ce7-a94b-4748-b261-7ba6236967af for instance 3408aa8b-4b63-4c7c-afd8-a7a1f236b712 on hv-cinder-75790 Dec 03 15:08:12.616767 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-010bce30-604a-4a38-a313-0968f605bfe8 req-04abae9b-32af-487a-b262-d7c97e829b36 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051444 Dec 03 15:08:12.617421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 362/753] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:08:12 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:08:12.653090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-34ccbabb-cf8a-447f-8ee3-b0ed9175ce47 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:12.654300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-34ccbabb-cf8a-447f-8ee3-b0ed9175ce47 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:12.663004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34ccbabb-cf8a-447f-8ee3-b0ed9175ce47 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:12.663521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34ccbabb-cf8a-447f-8ee3-b0ed9175ce47 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:12.664370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34ccbabb-cf8a-447f-8ee3-b0ed9175ce47 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:12.664863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34ccbabb-cf8a-447f-8ee3-b0ed9175ce47 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:12.882404 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-34ccbabb-cf8a-447f-8ee3-b0ed9175ce47 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 20164 microversion: 2.1 time: 0.238672 Dec 03 15:08:12.883073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 392/754] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:12 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 20164 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:13.268281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:13.269074 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:13.277875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:13.278420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:13.279291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:13.279790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:13.352127 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c9bf03e9-77e8-4065-8657-487a533a4982 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:13.353278 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c9bf03e9-77e8-4065-8657-487a533a4982 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:13.363251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:13.363763 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:13.364054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9bf03e9-77e8-4065-8657-487a533a4982 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:13.364280 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lazy-loading 'fault' on Instance uuid 3408aa8b-4b63-4c7c-afd8-a7a1f236b712 {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:08:13.364584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9bf03e9-77e8-4065-8657-487a533a4982 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:13.365712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9bf03e9-77e8-4065-8657-487a533a4982 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:13.366229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c9bf03e9-77e8-4065-8657-487a533a4982 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:13.452522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:13.460673 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-37c8eccf-ebca-4b73-98a7-c23e2b1abeaf tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 200 len: 1307 microversion: 2.1 time: 0.202708 Dec 03 15:08:13.461277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 363/755] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:13 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:13.566079 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c9bf03e9-77e8-4065-8657-487a533a4982 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 33770 microversion: 2.20 time: 0.224053 Dec 03 15:08:13.566813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 393/756] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:13 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 33770 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:13.900150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d87fc50b-fb6a-4194-9303-f14e42eb398f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:13.901685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d87fc50b-fb6a-4194-9303-f14e42eb398f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:13.909548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d87fc50b-fb6a-4194-9303-f14e42eb398f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:13.910079 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d87fc50b-fb6a-4194-9303-f14e42eb398f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:13.910907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d87fc50b-fb6a-4194-9303-f14e42eb398f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:13.911399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d87fc50b-fb6a-4194-9303-f14e42eb398f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:14.196986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d87fc50b-fb6a-4194-9303-f14e42eb398f tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 22134 microversion: 2.1 time: 0.305767 Dec 03 15:08:14.197610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 364/757] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:13 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 22134 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:14.488246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:14.488912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 3408aa8b-4b63-4c7c-afd8-a7a1f236b712] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:14.500891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:14.501501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:14.502952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:14.503789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:14.566304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] HTTP exception thrown: Instance 3408aa8b-4b63-4c7c-afd8-a7a1f236b712 could not be found. Dec 03 15:08:14.567039 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Returning 404 to user: Instance 3408aa8b-4b63-4c7c-afd8-a7a1f236b712 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:08:14.567946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-135a41bc-6bec-48a6-b940-534443a92cf9 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712" status: 404 len: 111 microversion: 2.1 time: 0.092080 Dec 03 15:08:14.568610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 394/758] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:14 2020] GET /compute/v2.1/servers/3408aa8b-4b63-4c7c-afd8-a7a1f236b712 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:08:14.586005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b7197b9d-96e1-4f54-a9b7-9be13c3dfcb9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:14.587158 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b7197b9d-96e1-4f54-a9b7-9be13c3dfcb9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:14.596392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7197b9d-96e1-4f54-a9b7-9be13c3dfcb9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:14.596898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7197b9d-96e1-4f54-a9b7-9be13c3dfcb9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:14.597751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7197b9d-96e1-4f54-a9b7-9be13c3dfcb9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:14.598271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7197b9d-96e1-4f54-a9b7-9be13c3dfcb9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:14.754499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b7197b9d-96e1-4f54-a9b7-9be13c3dfcb9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 34897 microversion: 2.20 time: 0.178681 Dec 03 15:08:14.755700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 365/759] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:14 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 34897 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:15.219140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0fdf8057-afd5-4da9-aeda-fbf10c819937 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:15.220206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0fdf8057-afd5-4da9-aeda-fbf10c819937 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:15.228222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0fdf8057-afd5-4da9-aeda-fbf10c819937 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:15.228725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0fdf8057-afd5-4da9-aeda-fbf10c819937 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:15.230376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0fdf8057-afd5-4da9-aeda-fbf10c819937 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:15.230867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0fdf8057-afd5-4da9-aeda-fbf10c819937 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:15.394395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0fdf8057-afd5-4da9-aeda-fbf10c819937 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 23225 microversion: 2.1 time: 0.184422 Dec 03 15:08:15.395031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 395/760] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:15 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 23225 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:15.775648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-55a50f67-0583-4dc5-b74c-272f7e103b55 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:15.776841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-55a50f67-0583-4dc5-b74c-272f7e103b55 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:15.786171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55a50f67-0583-4dc5-b74c-272f7e103b55 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:15.786687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55a50f67-0583-4dc5-b74c-272f7e103b55 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:15.787548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55a50f67-0583-4dc5-b74c-272f7e103b55 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:15.788037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55a50f67-0583-4dc5-b74c-272f7e103b55 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:15.877244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9420a1b0-abac-4dc0-91a3-280c4c9eedca tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:15.877938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9420a1b0-abac-4dc0-91a3-280c4c9eedca tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:15.887112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9420a1b0-abac-4dc0-91a3-280c4c9eedca tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:15.887626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9420a1b0-abac-4dc0-91a3-280c4c9eedca tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:15.888499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9420a1b0-abac-4dc0-91a3-280c4c9eedca tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:15.889000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9420a1b0-abac-4dc0-91a3-280c4c9eedca tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:15.960631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9420a1b0-abac-4dc0-91a3-280c4c9eedca tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:08:15.966480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-55a50f67-0583-4dc5-b74c-272f7e103b55 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 35689 microversion: 2.20 time: 0.200562 Dec 03 15:08:15.967425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 366/761] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:15 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 35689 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:16.081329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9420a1b0-abac-4dc0-91a3-280c4c9eedca tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "DELETE /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 204 len: 0 microversion: 2.1 time: 0.214890 Dec 03 15:08:16.081985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 396/762] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:08:15 2020] DELETE /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:08:16.097268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6d93fe7f-da2f-4eef-82d9-0bc546d2a403 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:16.098321 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6d93fe7f-da2f-4eef-82d9-0bc546d2a403 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:16.109138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6d93fe7f-da2f-4eef-82d9-0bc546d2a403 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:16.109653 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6d93fe7f-da2f-4eef-82d9-0bc546d2a403 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:16.110539 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6d93fe7f-da2f-4eef-82d9-0bc546d2a403 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:16.111035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6d93fe7f-da2f-4eef-82d9-0bc546d2a403 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:16.412393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7a4036f3-2bd8-4abc-8ddf-ebb5d94eded6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:16.413542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7a4036f3-2bd8-4abc-8ddf-ebb5d94eded6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:16.422044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a4036f3-2bd8-4abc-8ddf-ebb5d94eded6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:16.422559 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a4036f3-2bd8-4abc-8ddf-ebb5d94eded6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:16.423406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a4036f3-2bd8-4abc-8ddf-ebb5d94eded6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:16.423897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7a4036f3-2bd8-4abc-8ddf-ebb5d94eded6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:16.463179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6d93fe7f-da2f-4eef-82d9-0bc546d2a403 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:16.477087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6d93fe7f-da2f-4eef-82d9-0bc546d2a403 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1513 microversion: 2.1 time: 0.390027 Dec 03 15:08:16.478093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 367/763] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:16 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:16.571149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7a4036f3-2bd8-4abc-8ddf-ebb5d94eded6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 24401 microversion: 2.1 time: 0.168465 Dec 03 15:08:16.571942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 397/764] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:16 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 24401 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 15:08:16.985587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7188aea1-ff54-4ad5-a66e-73a25fc6d8d5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:16.986567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7188aea1-ff54-4ad5-a66e-73a25fc6d8d5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:16.994695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7188aea1-ff54-4ad5-a66e-73a25fc6d8d5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:16.995175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7188aea1-ff54-4ad5-a66e-73a25fc6d8d5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:16.996056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7188aea1-ff54-4ad5-a66e-73a25fc6d8d5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:16.996543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7188aea1-ff54-4ad5-a66e-73a25fc6d8d5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:17.156513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7188aea1-ff54-4ad5-a66e-73a25fc6d8d5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 36764 microversion: 2.20 time: 0.180670 Dec 03 15:08:17.157237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 368/765] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:16 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 36764 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:17.503474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-34b19c2d-d99d-4462-ad32-d3671cdc83c1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:17.504242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-34b19c2d-d99d-4462-ad32-d3671cdc83c1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:17.513050 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34b19c2d-d99d-4462-ad32-d3671cdc83c1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:17.513551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34b19c2d-d99d-4462-ad32-d3671cdc83c1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:17.514422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34b19c2d-d99d-4462-ad32-d3671cdc83c1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:17.514917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-34b19c2d-d99d-4462-ad32-d3671cdc83c1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:17.590750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c55cc9fe-dcde-499f-94e4-166660d62040 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:17.592011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c55cc9fe-dcde-499f-94e4-166660d62040 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:17.600741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c55cc9fe-dcde-499f-94e4-166660d62040 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:17.601242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c55cc9fe-dcde-499f-94e4-166660d62040 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:17.602113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c55cc9fe-dcde-499f-94e4-166660d62040 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:17.602599 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c55cc9fe-dcde-499f-94e4-166660d62040 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:17.733782 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-34b19c2d-d99d-4462-ad32-d3671cdc83c1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:17.743514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-34b19c2d-d99d-4462-ad32-d3671cdc83c1 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1513 microversion: 2.1 time: 0.250265 Dec 03 15:08:17.750586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 398/766] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:17 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:17.750742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c55cc9fe-dcde-499f-94e4-166660d62040 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 25322 microversion: 2.1 time: 0.164809 Dec 03 15:08:17.750742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 369/767] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:17 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 25322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 15:08:18.174467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1a42b61e-cca0-437a-8e5a-91d96527eb40 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:18.175610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1a42b61e-cca0-437a-8e5a-91d96527eb40 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:18.184083 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a42b61e-cca0-437a-8e5a-91d96527eb40 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:18.184591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a42b61e-cca0-437a-8e5a-91d96527eb40 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:18.185433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a42b61e-cca0-437a-8e5a-91d96527eb40 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:18.185951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a42b61e-cca0-437a-8e5a-91d96527eb40 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:18.404519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1a42b61e-cca0-437a-8e5a-91d96527eb40 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 37817 microversion: 2.20 time: 0.239184 Dec 03 15:08:18.405218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 399/768] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:18 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 37817 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:18.690480 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-7ca1e7d3-c49d-4eb2-a046-e00b95608eda req-22fb1286-1c26-400e-b7fb-b9b69ad9e4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36a1db4-149e-42e3-b996-ad70b23479b6", "name": "network-vif-unplugged", "status": "completed", "tag": "fdbe9e9c-8f3f-4fa7-9499-ca87a100ee37"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:18.697448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:08:18.697448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:08:18.707249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-7ca1e7d3-c49d-4eb2-a046-e00b95608eda req-22fb1286-1c26-400e-b7fb-b9b69ad9e4d7 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:18.707746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-7ca1e7d3-c49d-4eb2-a046-e00b95608eda req-22fb1286-1c26-400e-b7fb-b9b69ad9e4d7 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:18.725631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-7ca1e7d3-c49d-4eb2-a046-e00b95608eda req-22fb1286-1c26-400e-b7fb-b9b69ad9e4d7 service nova] Creating event network-vif-unplugged:fdbe9e9c-8f3f-4fa7-9499-ca87a100ee37 for instance c36a1db4-149e-42e3-b996-ad70b23479b6 on hv-cinder-75790 Dec 03 15:08:18.731553 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-7ca1e7d3-c49d-4eb2-a046-e00b95608eda req-22fb1286-1c26-400e-b7fb-b9b69ad9e4d7 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053463 Dec 03 15:08:18.732644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 370/769] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:08:18 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:08:18.767619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-354062cc-d316-48f0-a50a-d95b089d35a1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:18.768780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-354062cc-d316-48f0-a50a-d95b089d35a1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:18.774429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-42c6e40d-192b-4d02-97de-f309b05c843d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:18.775202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-42c6e40d-192b-4d02-97de-f309b05c843d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:18.778078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-354062cc-d316-48f0-a50a-d95b089d35a1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:18.778590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-354062cc-d316-48f0-a50a-d95b089d35a1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:18.779455 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-354062cc-d316-48f0-a50a-d95b089d35a1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:18.779952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-354062cc-d316-48f0-a50a-d95b089d35a1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:18.784343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-42c6e40d-192b-4d02-97de-f309b05c843d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:18.784853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-42c6e40d-192b-4d02-97de-f309b05c843d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:18.785702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-42c6e40d-192b-4d02-97de-f309b05c843d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:18.786226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-42c6e40d-192b-4d02-97de-f309b05c843d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:18.933328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-354062cc-d316-48f0-a50a-d95b089d35a1 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 26573 microversion: 2.1 time: 0.174573 Dec 03 15:08:18.934447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 400/770] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:18 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 26573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:19.391602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-42c6e40d-192b-4d02-97de-f309b05c843d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:19.400593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-42c6e40d-192b-4d02-97de-f309b05c843d tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1513 microversion: 2.1 time: 0.639402 Dec 03 15:08:19.401923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 371/771] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:18 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1513 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:19.423514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-15360160-7339-48dd-8ffd-0282e86b51f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:19.424773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-15360160-7339-48dd-8ffd-0282e86b51f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:19.433853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15360160-7339-48dd-8ffd-0282e86b51f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:19.434385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15360160-7339-48dd-8ffd-0282e86b51f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:19.435237 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15360160-7339-48dd-8ffd-0282e86b51f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:19.435733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15360160-7339-48dd-8ffd-0282e86b51f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:19.573671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-15360160-7339-48dd-8ffd-0282e86b51f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 38156 microversion: 2.20 time: 0.159530 Dec 03 15:08:19.574450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 401/772] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:19 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 38156 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:19.952612 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-82b5b836-12b1-4f06-9500-c7565d68d7b7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:19.953659 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-82b5b836-12b1-4f06-9500-c7565d68d7b7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:19.962062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82b5b836-12b1-4f06-9500-c7565d68d7b7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:19.962569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82b5b836-12b1-4f06-9500-c7565d68d7b7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:19.963455 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82b5b836-12b1-4f06-9500-c7565d68d7b7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:19.964562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-82b5b836-12b1-4f06-9500-c7565d68d7b7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:20.100978 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-82b5b836-12b1-4f06-9500-c7565d68d7b7 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 27496 microversion: 2.1 time: 0.158681 Dec 03 15:08:20.101740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 372/773] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:19 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 27496 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:20.425719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1a784ce6-94e0-44fa-9610-005c3c702308 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:20.426511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1a784ce6-94e0-44fa-9610-005c3c702308 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:20.436170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a784ce6-94e0-44fa-9610-005c3c702308 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:20.436678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a784ce6-94e0-44fa-9610-005c3c702308 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:20.437568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a784ce6-94e0-44fa-9610-005c3c702308 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:20.438104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1a784ce6-94e0-44fa-9610-005c3c702308 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:20.579078 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1a784ce6-94e0-44fa-9610-005c3c702308 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:20.588223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1a784ce6-94e0-44fa-9610-005c3c702308 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 200 len: 1471 microversion: 2.1 time: 0.172804 Dec 03 15:08:20.589765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 402/774] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:20 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:20.592607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cdd89ef4-ad15-4330-8d17-4d9b79c6fa12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:20.594128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cdd89ef4-ad15-4330-8d17-4d9b79c6fa12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:20.602839 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cdd89ef4-ad15-4330-8d17-4d9b79c6fa12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:20.603726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cdd89ef4-ad15-4330-8d17-4d9b79c6fa12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:20.604846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cdd89ef4-ad15-4330-8d17-4d9b79c6fa12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:20.605145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cdd89ef4-ad15-4330-8d17-4d9b79c6fa12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:20.625000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-91e96133-58ae-4954-9176-48d999cdcb20 req-c61956ef-8aaa-43d2-84f9-6a760a619323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36a1db4-149e-42e3-b996-ad70b23479b6", "name": "network-vif-deleted", "tag": "fdbe9e9c-8f3f-4fa7-9499-ca87a100ee37"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:20.632065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:08:20.632065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:08:20.642157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-91e96133-58ae-4954-9176-48d999cdcb20 req-c61956ef-8aaa-43d2-84f9-6a760a619323 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:20.642663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-91e96133-58ae-4954-9176-48d999cdcb20 req-c61956ef-8aaa-43d2-84f9-6a760a619323 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:20.661742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-91e96133-58ae-4954-9176-48d999cdcb20 req-c61956ef-8aaa-43d2-84f9-6a760a619323 service nova] Creating event network-vif-deleted:fdbe9e9c-8f3f-4fa7-9499-ca87a100ee37 for instance c36a1db4-149e-42e3-b996-ad70b23479b6 on hv-cinder-75790 Dec 03 15:08:20.667504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-91e96133-58ae-4954-9176-48d999cdcb20 req-c61956ef-8aaa-43d2-84f9-6a760a619323 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052388 Dec 03 15:08:20.668356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 403/775] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:08:20 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:08:20.773564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cdd89ef4-ad15-4330-8d17-4d9b79c6fa12 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 38156 microversion: 2.20 time: 0.190679 Dec 03 15:08:20.774966 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 373/776] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:20 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 38156 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:21.119235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-595b46ad-b246-44d0-b888-ad2290425e9c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:21.121255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-595b46ad-b246-44d0-b888-ad2290425e9c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:21.129654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-595b46ad-b246-44d0-b888-ad2290425e9c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.130267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-595b46ad-b246-44d0-b888-ad2290425e9c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.131066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-595b46ad-b246-44d0-b888-ad2290425e9c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.131554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-595b46ad-b246-44d0-b888-ad2290425e9c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.275484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-595b46ad-b246-44d0-b888-ad2290425e9c tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 27951 microversion: 2.1 time: 0.165829 Dec 03 15:08:21.276746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 404/777] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:21 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 27951 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:21.613567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:21.614369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: c36a1db4-149e-42e3-b996-ad70b23479b6] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:21.623618 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.624128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.625003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.625500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.679980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] HTTP exception thrown: Instance c36a1db4-149e-42e3-b996-ad70b23479b6 could not be found. Dec 03 15:08:21.680640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Returning 404 to user: Instance c36a1db4-149e-42e3-b996-ad70b23479b6 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:08:21.681805 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c71cf024-8d1b-4f2c-933c-95764c4628e6 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6" status: 404 len: 111 microversion: 2.1 time: 0.079039 Dec 03 15:08:21.682950 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 374/778] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:21 2020] GET /compute/v2.1/servers/c36a1db4-149e-42e3-b996-ad70b23479b6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:08:21.697448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d274b3d2-b8dc-41e0-9b11-3736c6ce5022 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:21.698789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d274b3d2-b8dc-41e0-9b11-3736c6ce5022 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:21.707447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d274b3d2-b8dc-41e0-9b11-3736c6ce5022 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.707910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d274b3d2-b8dc-41e0-9b11-3736c6ce5022 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.708757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d274b3d2-b8dc-41e0-9b11-3736c6ce5022 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.709249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d274b3d2-b8dc-41e0-9b11-3736c6ce5022 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.780727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d274b3d2-b8dc-41e0-9b11-3736c6ce5022 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:08:21.792350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9e0ed3fb-23f0-4c2d-b971-66e7e0a416cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:21.793506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9e0ed3fb-23f0-4c2d-b971-66e7e0a416cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:21.801549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e0ed3fb-23f0-4c2d-b971-66e7e0a416cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.802531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e0ed3fb-23f0-4c2d-b971-66e7e0a416cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.802992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e0ed3fb-23f0-4c2d-b971-66e7e0a416cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.803489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e0ed3fb-23f0-4c2d-b971-66e7e0a416cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.902468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d274b3d2-b8dc-41e0-9b11-3736c6ce5022 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "DELETE /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 204 len: 0 microversion: 2.1 time: 0.214325 Dec 03 15:08:21.903134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 405/779] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:08:21 2020] DELETE /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:08:21.917519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8daafbfe-afd3-4f06-a928-7b875aeca769 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:21.918339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8daafbfe-afd3-4f06-a928-7b875aeca769 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:21.926645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8daafbfe-afd3-4f06-a928-7b875aeca769 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.927167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8daafbfe-afd3-4f06-a928-7b875aeca769 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.928031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8daafbfe-afd3-4f06-a928-7b875aeca769 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.928531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8daafbfe-afd3-4f06-a928-7b875aeca769 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.941435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9e0ed3fb-23f0-4c2d-b971-66e7e0a416cb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 200 len: 38297 microversion: 2.20 time: 0.158368 Dec 03 15:08:21.942540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 375/780] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:21 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 38297 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 15:08:21.959718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d61c01a1-47d9-4648-83f8-95a1f563204a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:21.960300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d61c01a1-47d9-4648-83f8-95a1f563204a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:21.970696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d61c01a1-47d9-4648-83f8-95a1f563204a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.971210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d61c01a1-47d9-4648-83f8-95a1f563204a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:21.972069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d61c01a1-47d9-4648-83f8-95a1f563204a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:21.972571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d61c01a1-47d9-4648-83f8-95a1f563204a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:22.043408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d61c01a1-47d9-4648-83f8-95a1f563204a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/ips" status: 200 len: 153 microversion: 2.20 time: 0.093638 Dec 03 15:08:22.044060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 376/781] 10.222.0.63 () {60 vars in 1279 bytes} [Thu Dec 3 15:08:21 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/ips => generated 153 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 15:08:22.151776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8daafbfe-afd3-4f06-a928-7b875aeca769 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:22.160780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8daafbfe-afd3-4f06-a928-7b875aeca769 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1514 microversion: 2.1 time: 0.253156 Dec 03 15:08:22.161431 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 406/782] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:21 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:08:22.294736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fac473fd-7f79-4b45-b268-681eaf53e892 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:22.295790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fac473fd-7f79-4b45-b268-681eaf53e892 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:22.303779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fac473fd-7f79-4b45-b268-681eaf53e892 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:22.304333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fac473fd-7f79-4b45-b268-681eaf53e892 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:22.305185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fac473fd-7f79-4b45-b268-681eaf53e892 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:22.305685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fac473fd-7f79-4b45-b268-681eaf53e892 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:22.458888 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fac473fd-7f79-4b45-b268-681eaf53e892 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 28205 microversion: 2.1 time: 0.173600 Dec 03 15:08:22.459931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 377/783] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:22 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 28205 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:23.186166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cd278dd9-f59f-41cf-981f-e001c20b66d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:23.186845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cd278dd9-f59f-41cf-981f-e001c20b66d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:23.195187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cd278dd9-f59f-41cf-981f-e001c20b66d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:23.195704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cd278dd9-f59f-41cf-981f-e001c20b66d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:23.196552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cd278dd9-f59f-41cf-981f-e001c20b66d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:23.197048 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cd278dd9-f59f-41cf-981f-e001c20b66d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:23.429779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cd278dd9-f59f-41cf-981f-e001c20b66d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:23.440505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cd278dd9-f59f-41cf-981f-e001c20b66d0 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1514 microversion: 2.1 time: 0.264534 Dec 03 15:08:23.441148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 407/784] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:23 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:23.478624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b13e865e-99ce-4cb3-8305-3ead5f3dd029 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:23.480353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b13e865e-99ce-4cb3-8305-3ead5f3dd029 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:23.489793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13e865e-99ce-4cb3-8305-3ead5f3dd029 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:23.490323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13e865e-99ce-4cb3-8305-3ead5f3dd029 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:23.491204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13e865e-99ce-4cb3-8305-3ead5f3dd029 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:23.491687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13e865e-99ce-4cb3-8305-3ead5f3dd029 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:23.665189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b13e865e-99ce-4cb3-8305-3ead5f3dd029 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 28205 microversion: 2.1 time: 0.196373 Dec 03 15:08:23.665827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 378/785] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:23 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 28205 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:24.461870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-db598aa2-a44b-4056-8e7e-76fb7a9e6ca1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:24.462585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-db598aa2-a44b-4056-8e7e-76fb7a9e6ca1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:24.464845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ebd1cf0a-a2a2-4b00-a160-cabd01e5703c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:24.465608 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ebd1cf0a-a2a2-4b00-a160-cabd01e5703c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:24.471536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db598aa2-a44b-4056-8e7e-76fb7a9e6ca1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.472050 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db598aa2-a44b-4056-8e7e-76fb7a9e6ca1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:24.472954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db598aa2-a44b-4056-8e7e-76fb7a9e6ca1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.473453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db598aa2-a44b-4056-8e7e-76fb7a9e6ca1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:24.474194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebd1cf0a-a2a2-4b00-a160-cabd01e5703c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.474755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebd1cf0a-a2a2-4b00-a160-cabd01e5703c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:24.475588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebd1cf0a-a2a2-4b00-a160-cabd01e5703c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.476081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebd1cf0a-a2a2-4b00-a160-cabd01e5703c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:24.542028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-db598aa2-a44b-4056-8e7e-76fb7a9e6ca1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lazy-loading 'flavor' on Instance uuid e2dedaf2-51f5-458f-8e08-7814bc6780c3 {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:08:24.676953 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ebd1cf0a-a2a2-4b00-a160-cabd01e5703c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:24.686479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ebd1cf0a-a2a2-4b00-a160-cabd01e5703c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 200 len: 1472 microversion: 2.1 time: 0.231596 Dec 03 15:08:24.687076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 379/786] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:24 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:24.697052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-691b75a0-e00b-40f8-b6c7-106f740b4986 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:24.699065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-691b75a0-e00b-40f8-b6c7-106f740b4986 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:24.706890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-691b75a0-e00b-40f8-b6c7-106f740b4986 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.707394 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-691b75a0-e00b-40f8-b6c7-106f740b4986 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:24.708246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-691b75a0-e00b-40f8-b6c7-106f740b4986 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.708762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-691b75a0-e00b-40f8-b6c7-106f740b4986 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:24.867465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-691b75a0-e00b-40f8-b6c7-106f740b4986 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 28496 microversion: 2.1 time: 0.178794 Dec 03 15:08:24.868533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 380/787] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:24 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 28496 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:24.880405 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-051ca6f0-766e-4b9c-93c1-73be67ed3e39 req-8e25eda1-9cdb-4f1f-9b9a-f42880957317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237e9415-9a21-4351-b7c0-74006a517e0a", "name": "network-vif-deleted", "tag": "053ac7af-3e23-4053-88ee-80372f87f915"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:24.887571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:08:24.887571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:08:24.896894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-051ca6f0-766e-4b9c-93c1-73be67ed3e39 req-8e25eda1-9cdb-4f1f-9b9a-f42880957317 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.897392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-051ca6f0-766e-4b9c-93c1-73be67ed3e39 req-8e25eda1-9cdb-4f1f-9b9a-f42880957317 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:24.915910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-051ca6f0-766e-4b9c-93c1-73be67ed3e39 req-8e25eda1-9cdb-4f1f-9b9a-f42880957317 service nova] Creating event network-vif-deleted:053ac7af-3e23-4053-88ee-80372f87f915 for instance 237e9415-9a21-4351-b7c0-74006a517e0a on hv-cinder-75790 Dec 03 15:08:24.920909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-051ca6f0-766e-4b9c-93c1-73be67ed3e39 req-8e25eda1-9cdb-4f1f-9b9a-f42880957317 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051007 Dec 03 15:08:24.921542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 381/788] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:08:24 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:08:24.931225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-db598aa2-a44b-4056-8e7e-76fb7a9e6ca1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 202 len: 0 microversion: 2.20 time: 0.478518 Dec 03 15:08:24.932830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 408/789] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:24 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:08:24.947058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:24.948245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:24.957267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.957872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:24.958790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:24.959290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:25.186967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:25.201739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:25.208351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:25.209545 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2158ea32-a291-41f4-b097-c2db3ae31df8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.272545 Dec 03 15:08:25.210453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 382/790] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:24 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:08:25.711614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:25.712297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: 237e9415-9a21-4351-b7c0-74006a517e0a] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:25.721314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:25.721823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:25.722688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:25.723178 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:25.776916 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] HTTP exception thrown: Instance 237e9415-9a21-4351-b7c0-74006a517e0a could not be found. Dec 03 15:08:25.777562 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Returning 404 to user: Instance 237e9415-9a21-4351-b7c0-74006a517e0a could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:08:25.778519 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c7a9b7d9-5133-4723-9f35-01abc28e3d03 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a" status: 404 len: 111 microversion: 2.1 time: 0.077676 Dec 03 15:08:25.779133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 409/791] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:25 2020] GET /compute/v2.1/servers/237e9415-9a21-4351-b7c0-74006a517e0a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:08:25.885654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cd34eabf-cbca-4a75-ab35-fe95aa8da912 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:25.886961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cd34eabf-cbca-4a75-ab35-fe95aa8da912 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:25.896195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cd34eabf-cbca-4a75-ab35-fe95aa8da912 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:25.896699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cd34eabf-cbca-4a75-ab35-fe95aa8da912 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:25.897546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cd34eabf-cbca-4a75-ab35-fe95aa8da912 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:25.898090 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cd34eabf-cbca-4a75-ab35-fe95aa8da912 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:26.046030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cd34eabf-cbca-4a75-ab35-fe95aa8da912 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 28664 microversion: 2.1 time: 0.169250 Dec 03 15:08:26.046741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 383/792] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:25 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 28664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:26.234996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:26.235773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:26.243610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:26.244114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:26.245109 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:26.245598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:26.465069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:26.481124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:26.487839 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:26.489047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-29259588-bb3c-44a5-b18d-90bad3ce4cb5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.264064 Dec 03 15:08:26.489648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 410/793] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:26 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:27.038822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-99efe83e-9838-4a9a-8d3b-5119c2ed150b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:27.039470 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-99efe83e-9838-4a9a-8d3b-5119c2ed150b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:27.048403 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99efe83e-9838-4a9a-8d3b-5119c2ed150b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:27.048824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99efe83e-9838-4a9a-8d3b-5119c2ed150b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:27.049651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99efe83e-9838-4a9a-8d3b-5119c2ed150b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:27.050179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-99efe83e-9838-4a9a-8d3b-5119c2ed150b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:27.063995 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9ef27bb9-f768-4d52-94e2-831f147291ee tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:27.065130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9ef27bb9-f768-4d52-94e2-831f147291ee tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:27.074686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ef27bb9-f768-4d52-94e2-831f147291ee tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:27.075201 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ef27bb9-f768-4d52-94e2-831f147291ee tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:27.076047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ef27bb9-f768-4d52-94e2-831f147291ee tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:27.076540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9ef27bb9-f768-4d52-94e2-831f147291ee tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:27.126364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-99efe83e-9838-4a9a-8d3b-5119c2ed150b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:08:27.216439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9ef27bb9-f768-4d52-94e2-831f147291ee tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 28664 microversion: 2.1 time: 0.161879 Dec 03 15:08:27.217379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 411/794] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:27 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 28664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 15:08:27.241121 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-99efe83e-9838-4a9a-8d3b-5119c2ed150b tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "DELETE /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 204 len: 0 microversion: 2.1 time: 0.211621 Dec 03 15:08:27.241744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 384/795] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:08:27 2020] DELETE /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:08:27.256482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-28152d8b-772c-4587-831e-1c174e8f22fa tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:27.257243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-28152d8b-772c-4587-831e-1c174e8f22fa tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:27.266581 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-28152d8b-772c-4587-831e-1c174e8f22fa tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:27.267087 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-28152d8b-772c-4587-831e-1c174e8f22fa tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:27.267924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-28152d8b-772c-4587-831e-1c174e8f22fa tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:27.268410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-28152d8b-772c-4587-831e-1c174e8f22fa tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:27.496481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-28152d8b-772c-4587-831e-1c174e8f22fa tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:27.505456 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-28152d8b-772c-4587-831e-1c174e8f22fa tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1513 microversion: 2.1 time: 0.258751 Dec 03 15:08:27.506070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 412/796] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:27 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:27.514573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:27.515361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:27.523279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:27.523821 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:27.524650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:27.525146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:27.747973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:27.763789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:27.770399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:27.771618 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b134f6ea-bbee-48e8-a506-d5098e13467e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.267514 Dec 03 15:08:27.772255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 385/797] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:27 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:08:28.235678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4b48ddcc-4450-4ccb-a686-ced5d97d11cd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:28.236736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4b48ddcc-4450-4ccb-a686-ced5d97d11cd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:28.245879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b48ddcc-4450-4ccb-a686-ced5d97d11cd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:28.246421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b48ddcc-4450-4ccb-a686-ced5d97d11cd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:28.247316 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b48ddcc-4450-4ccb-a686-ced5d97d11cd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:28.247817 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b48ddcc-4450-4ccb-a686-ced5d97d11cd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:28.395155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4b48ddcc-4450-4ccb-a686-ced5d97d11cd tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 28664 microversion: 2.1 time: 0.169871 Dec 03 15:08:28.395865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 413/798] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:28 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 28664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:28.530000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8b6d4cb4-67aa-4d1f-8303-7e806a061a4c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:28.530678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8b6d4cb4-67aa-4d1f-8303-7e806a061a4c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:28.539165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b6d4cb4-67aa-4d1f-8303-7e806a061a4c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:28.539680 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b6d4cb4-67aa-4d1f-8303-7e806a061a4c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:28.540520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b6d4cb4-67aa-4d1f-8303-7e806a061a4c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:28.541022 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8b6d4cb4-67aa-4d1f-8303-7e806a061a4c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:28.786924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8b6d4cb4-67aa-4d1f-8303-7e806a061a4c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:28.797061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8b6d4cb4-67aa-4d1f-8303-7e806a061a4c tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1513 microversion: 2.1 time: 0.276333 Dec 03 15:08:28.797242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 386/799] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:28 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:28.800216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:28.801012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:28.810674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:28.811190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:28.812045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:28.812543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:29.038378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:29.053501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:29.060439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:29.061611 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4b38b86f-0dc9-42b6-a079-79094113cf3a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.272896 Dec 03 15:08:29.062240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 414/800] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:28 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:08:29.414537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-90d2136c-880b-480b-9915-570bb651bccb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:29.415581 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-90d2136c-880b-480b-9915-570bb651bccb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:29.423552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90d2136c-880b-480b-9915-570bb651bccb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:29.424063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90d2136c-880b-480b-9915-570bb651bccb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:29.424905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90d2136c-880b-480b-9915-570bb651bccb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:29.425399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90d2136c-880b-480b-9915-570bb651bccb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:29.552840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-90d2136c-880b-480b-9915-570bb651bccb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 28664 microversion: 2.1 time: 0.147255 Dec 03 15:08:29.558159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 387/801] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:29 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 28664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:29.820479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8f8f332b-9a70-4cd5-abe4-1f7a74c93366 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:29.821151 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8f8f332b-9a70-4cd5-abe4-1f7a74c93366 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:29.830444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f8f332b-9a70-4cd5-abe4-1f7a74c93366 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:29.830957 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f8f332b-9a70-4cd5-abe4-1f7a74c93366 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:29.831813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f8f332b-9a70-4cd5-abe4-1f7a74c93366 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:29.832320 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f8f332b-9a70-4cd5-abe4-1f7a74c93366 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:30.055159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8f8f332b-9a70-4cd5-abe4-1f7a74c93366 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118cea2a12b4c81849eef6cfe727aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a474d63897e4433e9e4b034785e66430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:30.065445 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8f8f332b-9a70-4cd5-abe4-1f7a74c93366 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 200 len: 1513 microversion: 2.1 time: 0.254386 Dec 03 15:08:30.066098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 415/802] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:29 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:30.089462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:30.090307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:30.098977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:30.099463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:30.100315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:30.100809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:30.313554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-62d2d617-e444-4288-acd3-4542b974551b req-37985367-3e31-453d-a18a-d30a62c877d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec457aab-c441-4e97-a4ff-58563d635312", "name": "network-vif-deleted", "tag": "a55825db-cdc0-4b32-8a2a-482be28dafcc"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:30.320375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:08:30.320375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:08:30.329614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-62d2d617-e444-4288-acd3-4542b974551b req-37985367-3e31-453d-a18a-d30a62c877d9 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:30.330150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-62d2d617-e444-4288-acd3-4542b974551b req-37985367-3e31-453d-a18a-d30a62c877d9 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:30.348839 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-62d2d617-e444-4288-acd3-4542b974551b req-37985367-3e31-453d-a18a-d30a62c877d9 service nova] Creating event network-vif-deleted:a55825db-cdc0-4b32-8a2a-482be28dafcc for instance ec457aab-c441-4e97-a4ff-58563d635312 on hv-cinder-75790 Dec 03 15:08:30.353680 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-62d2d617-e444-4288-acd3-4542b974551b req-37985367-3e31-453d-a18a-d30a62c877d9 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049687 Dec 03 15:08:30.355131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 416/803] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:08:30 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:08:30.401855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:30.417175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:30.423838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:30.425022 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-15c1c85b-6e42-4508-a037-34d7ee4f079a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.346439 Dec 03 15:08:30.425586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 388/804] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:30 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:30.572681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9174f6eb-3067-40ce-b780-3b6309801f0b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:30.573747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9174f6eb-3067-40ce-b780-3b6309801f0b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:30.581719 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9174f6eb-3067-40ce-b780-3b6309801f0b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:30.582257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9174f6eb-3067-40ce-b780-3b6309801f0b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:30.583192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9174f6eb-3067-40ce-b780-3b6309801f0b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:30.583677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9174f6eb-3067-40ce-b780-3b6309801f0b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:30.729473 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9174f6eb-3067-40ce-b780-3b6309801f0b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 29457 microversion: 2.1 time: 0.166475 Dec 03 15:08:30.730217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 417/805] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:30 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 29457 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:31.089575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:31.090187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] [instance: ec457aab-c441-4e97-a4ff-58563d635312] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:31.098843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:31.099355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:31.100194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:31.100691 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:31.156780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] HTTP exception thrown: Instance ec457aab-c441-4e97-a4ff-58563d635312 could not be found. Dec 03 15:08:31.157455 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] Returning 404 to user: Instance ec457aab-c441-4e97-a4ff-58563d635312 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:08:31.158390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2be4b2b6-6a54-450f-9e61-89237eaeb691 tempest-AttachVolumeNegativeTest-490920730 tempest-AttachVolumeNegativeTest-490920730] 10.222.0.63 "GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312" status: 404 len: 111 microversion: 2.1 time: 0.078374 Dec 03 15:08:31.159006 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 389/806] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:31 2020] GET /compute/v2.1/servers/ec457aab-c441-4e97-a4ff-58563d635312 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:08:31.451602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:31.452384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:31.461052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:31.461574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:31.462536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:31.463004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:31.747030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cf566d72-af5c-491f-896b-89d652bb83f6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:31.748103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cf566d72-af5c-491f-896b-89d652bb83f6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:31.756183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf566d72-af5c-491f-896b-89d652bb83f6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:31.756694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf566d72-af5c-491f-896b-89d652bb83f6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:31.757549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf566d72-af5c-491f-896b-89d652bb83f6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:31.758071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf566d72-af5c-491f-896b-89d652bb83f6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:31.902685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cf566d72-af5c-491f-896b-89d652bb83f6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 31417 microversion: 2.1 time: 0.165328 Dec 03 15:08:31.906959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 390/807] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:31 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 31417 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:31.919478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:31.934640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:31.941123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:31.942383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0b539f4d-d410-418a-b564-6185baa5398c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.501214 Dec 03 15:08:31.942975 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 418/808] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:31 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:32.151961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b365ff1d-b1c3-40e9-b15f-dd1e3751d23d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:32.152653 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b365ff1d-b1c3-40e9-b15f-dd1e3751d23d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:32.162211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b365ff1d-b1c3-40e9-b15f-dd1e3751d23d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:32.162692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b365ff1d-b1c3-40e9-b15f-dd1e3751d23d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:32.163550 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b365ff1d-b1c3-40e9-b15f-dd1e3751d23d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:32.164043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b365ff1d-b1c3-40e9-b15f-dd1e3751d23d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:32.233814 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-b365ff1d-b1c3-40e9-b15f-dd1e3751d23d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lazy-loading 'flavor' on Instance uuid add146c2-e4cc-491e-b5f9-17673e4a0c89 {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:08:32.385198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b365ff1d-b1c3-40e9-b15f-dd1e3751d23d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89/action" status: 202 len: 0 microversion: 2.1 time: 0.243518 Dec 03 15:08:32.385848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 391/809] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:32 2020] POST /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:32.399836 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-518d2c45-4706-400b-bca7-9f55f1489d5a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:32.400506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-518d2c45-4706-400b-bca7-9f55f1489d5a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:32.408742 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-518d2c45-4706-400b-bca7-9f55f1489d5a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:32.409260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-518d2c45-4706-400b-bca7-9f55f1489d5a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:32.410151 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-518d2c45-4706-400b-bca7-9f55f1489d5a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:32.410650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-518d2c45-4706-400b-bca7-9f55f1489d5a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:32.659746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-518d2c45-4706-400b-bca7-9f55f1489d5a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:32.669924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-518d2c45-4706-400b-bca7-9f55f1489d5a tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.279240 Dec 03 15:08:32.670554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 419/810] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:32 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:32.922204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f0710599-a6e6-4821-9907-4402567471c6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:32.923359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f0710599-a6e6-4821-9907-4402567471c6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:32.932474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0710599-a6e6-4821-9907-4402567471c6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:32.933291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0710599-a6e6-4821-9907-4402567471c6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:32.934066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0710599-a6e6-4821-9907-4402567471c6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:32.934559 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0710599-a6e6-4821-9907-4402567471c6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:32.967095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:32.969393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:32.976159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:32.976757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:32.977692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:32.978418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:33.078417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f0710599-a6e6-4821-9907-4402567471c6 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 32550 microversion: 2.1 time: 0.166715 Dec 03 15:08:33.079766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 392/811] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:32 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 32550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:33.210809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:33.226538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:33.233880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:33.235122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-245f2772-c41e-4c59-b7aa-2e5de1b8f9fe tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.278294 Dec 03 15:08:33.235720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 420/812] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:32 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:08:33.694142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b53f8860-c009-4b88-a2c0-1441693f92e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:33.694922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b53f8860-c009-4b88-a2c0-1441693f92e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:33.703901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b53f8860-c009-4b88-a2c0-1441693f92e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:33.704409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b53f8860-c009-4b88-a2c0-1441693f92e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:33.705250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b53f8860-c009-4b88-a2c0-1441693f92e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:33.705745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b53f8860-c009-4b88-a2c0-1441693f92e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:33.931506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b53f8860-c009-4b88-a2c0-1441693f92e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:33.941070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b53f8860-c009-4b88-a2c0-1441693f92e7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.256778 Dec 03 15:08:33.941674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 393/813] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:33 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:34.100345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-498af2e7-bfea-457d-a1c4-6851cff9f019 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:34.101487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-498af2e7-bfea-457d-a1c4-6851cff9f019 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:34.110142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-498af2e7-bfea-457d-a1c4-6851cff9f019 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:34.110733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-498af2e7-bfea-457d-a1c4-6851cff9f019 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:34.111650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-498af2e7-bfea-457d-a1c4-6851cff9f019 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:34.112215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-498af2e7-bfea-457d-a1c4-6851cff9f019 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:34.260572 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:34.261313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:34.267397 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-498af2e7-bfea-457d-a1c4-6851cff9f019 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 33361 microversion: 2.1 time: 0.176378 Dec 03 15:08:34.272035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:34.272035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:34.272035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:34.272035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:34.272953 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 421/814] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:34 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 33361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:34.501716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:34.516604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:34.523094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:34.524295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b6dcb050-832c-444b-9108-e757842f69e2 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.273052 Dec 03 15:08:34.524875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 394/815] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:34 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:34.965750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a09e2c52-1053-42a0-9a93-588eb6181540 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:34.966601 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a09e2c52-1053-42a0-9a93-588eb6181540 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:34.978479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a09e2c52-1053-42a0-9a93-588eb6181540 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:34.979005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a09e2c52-1053-42a0-9a93-588eb6181540 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:34.980194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a09e2c52-1053-42a0-9a93-588eb6181540 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:34.980701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a09e2c52-1053-42a0-9a93-588eb6181540 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:35.204990 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a09e2c52-1053-42a0-9a93-588eb6181540 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:35.214635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a09e2c52-1053-42a0-9a93-588eb6181540 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.258759 Dec 03 15:08:35.215159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 422/816] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:34 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:35.285504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cf402eb5-2471-40c6-970c-5648f199962d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:35.286674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cf402eb5-2471-40c6-970c-5648f199962d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:35.296774 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf402eb5-2471-40c6-970c-5648f199962d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:35.297274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf402eb5-2471-40c6-970c-5648f199962d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:35.298157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf402eb5-2471-40c6-970c-5648f199962d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:35.298648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cf402eb5-2471-40c6-970c-5648f199962d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:35.445487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cf402eb5-2471-40c6-970c-5648f199962d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 34262 microversion: 2.1 time: 0.169230 Dec 03 15:08:35.446496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 395/817] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:35 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 34262 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:35.550923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:35.551819 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:35.560515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:35.561113 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:35.562094 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:35.562685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:35.811610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:35.826971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:35.833573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:35.834829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-66ef05d3-bbfa-4f26-8ab0-d2767f9e851e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1746 microversion: 2.20 time: 0.294652 Dec 03 15:08:35.835432 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 423/818] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:35 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1746 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:36.239980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ebf0af56-c97c-4cfb-9592-871b45465d4e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:36.240816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ebf0af56-c97c-4cfb-9592-871b45465d4e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:36.250322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebf0af56-c97c-4cfb-9592-871b45465d4e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:36.250911 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebf0af56-c97c-4cfb-9592-871b45465d4e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:36.251920 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebf0af56-c97c-4cfb-9592-871b45465d4e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:36.252487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ebf0af56-c97c-4cfb-9592-871b45465d4e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:36.464203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3b97c253-763e-4dd6-9513-1ae49987df84 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:36.465173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3b97c253-763e-4dd6-9513-1ae49987df84 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:36.474310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b97c253-763e-4dd6-9513-1ae49987df84 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:36.474829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b97c253-763e-4dd6-9513-1ae49987df84 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:36.475687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b97c253-763e-4dd6-9513-1ae49987df84 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:36.476185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b97c253-763e-4dd6-9513-1ae49987df84 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:36.568352 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ebf0af56-c97c-4cfb-9592-871b45465d4e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:36.577893 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ebf0af56-c97c-4cfb-9592-871b45465d4e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.348788 Dec 03 15:08:36.578599 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 396/819] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:36 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:36.628172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3b97c253-763e-4dd6-9513-1ae49987df84 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 35401 microversion: 2.1 time: 0.173672 Dec 03 15:08:36.632494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 424/820] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:36 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 35401 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:36.860066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:36.860763 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:36.868697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:36.869227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:36.870307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:36.870820 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:37.101567 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:37.116546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:37.123867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:37.125068 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fd505866-4ccc-4221-aa7d-6a28fc782d70 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1746 microversion: 2.20 time: 0.274392 Dec 03 15:08:37.125647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 397/821] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:36 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1746 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:37.604511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9cc0bdcd-a00f-4e27-aa37-dd1b488d9e51 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:37.605328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9cc0bdcd-a00f-4e27-aa37-dd1b488d9e51 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:37.614085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9cc0bdcd-a00f-4e27-aa37-dd1b488d9e51 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:37.614592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9cc0bdcd-a00f-4e27-aa37-dd1b488d9e51 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:37.615463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9cc0bdcd-a00f-4e27-aa37-dd1b488d9e51 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:37.615965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9cc0bdcd-a00f-4e27-aa37-dd1b488d9e51 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:37.646580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-246aaf6c-9ad4-44bc-94b9-13edffd9b59a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:37.647759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-246aaf6c-9ad4-44bc-94b9-13edffd9b59a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:37.657496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-246aaf6c-9ad4-44bc-94b9-13edffd9b59a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:37.658170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-246aaf6c-9ad4-44bc-94b9-13edffd9b59a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:37.659111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-246aaf6c-9ad4-44bc-94b9-13edffd9b59a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:37.659698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-246aaf6c-9ad4-44bc-94b9-13edffd9b59a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:37.820677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-246aaf6c-9ad4-44bc-94b9-13edffd9b59a tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 36324 microversion: 2.1 time: 0.182860 Dec 03 15:08:37.822529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 398/822] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:37 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 36324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:37.979436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9cc0bdcd-a00f-4e27-aa37-dd1b488d9e51 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:37.989029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9cc0bdcd-a00f-4e27-aa37-dd1b488d9e51 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.395475 Dec 03 15:08:37.989644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 425/823] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:37 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:38.164283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:38.165705 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:38.183793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:38.184701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:38.186245 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:38.187139 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:38.495175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:38.511017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:38.517561 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:38.518985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a339f4c7-2703-411d-9c1f-5a27677fb717 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.376380 Dec 03 15:08:38.519576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 399/824] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:38 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:38.839602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-766f23e8-b48c-4b60-83d5-88458f11ffa3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:38.841659 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-766f23e8-b48c-4b60-83d5-88458f11ffa3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:38.852044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-766f23e8-b48c-4b60-83d5-88458f11ffa3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:38.852689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-766f23e8-b48c-4b60-83d5-88458f11ffa3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:38.853947 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-766f23e8-b48c-4b60-83d5-88458f11ffa3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:38.855131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-766f23e8-b48c-4b60-83d5-88458f11ffa3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:39.014005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-766f23e8-b48c-4b60-83d5-88458f11ffa3 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 37696 microversion: 2.1 time: 0.183523 Dec 03 15:08:39.018354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 426/825] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:38 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 37696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 15:08:39.020304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-70a79721-e3fc-422e-9622-e5bcdc693039 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:39.021164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-70a79721-e3fc-422e-9622-e5bcdc693039 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:39.030475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-70a79721-e3fc-422e-9622-e5bcdc693039 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:39.031239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-70a79721-e3fc-422e-9622-e5bcdc693039 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:39.032276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-70a79721-e3fc-422e-9622-e5bcdc693039 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:39.032923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-70a79721-e3fc-422e-9622-e5bcdc693039 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:39.307341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-70a79721-e3fc-422e-9622-e5bcdc693039 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:39.312878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-70a79721-e3fc-422e-9622-e5bcdc693039 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.308797 Dec 03 15:08:39.314032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 400/826] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:39 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:39.545987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:39.547157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:39.555952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:39.557318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:39.567982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:39.568516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:39.833012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:39.850335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:39.857518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:39.859195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8c94a48a-9281-419a-98c9-e3f94f9b3421 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.323616 Dec 03 15:08:39.860228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 427/827] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:39 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:40.033505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-642b0fa7-18db-40ab-8b93-d7aaf16b6110 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:40.034705 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-642b0fa7-18db-40ab-8b93-d7aaf16b6110 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:40.044655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-642b0fa7-18db-40ab-8b93-d7aaf16b6110 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:40.045174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-642b0fa7-18db-40ab-8b93-d7aaf16b6110 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:40.046026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-642b0fa7-18db-40ab-8b93-d7aaf16b6110 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:40.046688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-642b0fa7-18db-40ab-8b93-d7aaf16b6110 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:40.217410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-642b0fa7-18db-40ab-8b93-d7aaf16b6110 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 38194 microversion: 2.1 time: 0.193662 Dec 03 15:08:40.222001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 401/828] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:40 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 38194 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 15:08:40.339066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-60bd9ea6-c124-4ac9-9d32-331aa1f4246f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:40.339675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-60bd9ea6-c124-4ac9-9d32-331aa1f4246f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:40.348964 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60bd9ea6-c124-4ac9-9d32-331aa1f4246f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:40.349486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60bd9ea6-c124-4ac9-9d32-331aa1f4246f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:40.350377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60bd9ea6-c124-4ac9-9d32-331aa1f4246f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:40.350875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60bd9ea6-c124-4ac9-9d32-331aa1f4246f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:40.637428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-60bd9ea6-c124-4ac9-9d32-331aa1f4246f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:40.647007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-60bd9ea6-c124-4ac9-9d32-331aa1f4246f tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.317532 Dec 03 15:08:40.647634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 428/829] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:40 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:40.887703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:40.888429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:40.901487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:40.902474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:40.903579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:40.904282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:41.169271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:41.187453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:41.194499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:41.195739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f6b0554c-1ece-4ad3-a9fe-31790bf3cc51 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.318388 Dec 03 15:08:41.196522 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 402/830] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:40 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:41.236409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-453aa4b9-df89-4483-8428-594d7db554ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:41.237483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-453aa4b9-df89-4483-8428-594d7db554ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:41.247516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-453aa4b9-df89-4483-8428-594d7db554ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:41.248225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-453aa4b9-df89-4483-8428-594d7db554ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:41.249240 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-453aa4b9-df89-4483-8428-594d7db554ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:41.249800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-453aa4b9-df89-4483-8428-594d7db554ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:41.392494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-453aa4b9-df89-4483-8428-594d7db554ed tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 38194 microversion: 2.1 time: 0.166271 Dec 03 15:08:41.393210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 429/831] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:41 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 38194 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:41.671999 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-96a2a6b1-2593-4fa7-b358-f94fdd5211c3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:41.673072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-96a2a6b1-2593-4fa7-b358-f94fdd5211c3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:41.682931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-96a2a6b1-2593-4fa7-b358-f94fdd5211c3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:41.683566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-96a2a6b1-2593-4fa7-b358-f94fdd5211c3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:41.684539 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-96a2a6b1-2593-4fa7-b358-f94fdd5211c3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:41.685117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-96a2a6b1-2593-4fa7-b358-f94fdd5211c3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:41.976363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-96a2a6b1-2593-4fa7-b358-f94fdd5211c3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:41.987644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-96a2a6b1-2593-4fa7-b358-f94fdd5211c3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.326662 Dec 03 15:08:41.988556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 403/832] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:41 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:42.224438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:42.225292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:42.235784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:42.236304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:42.237177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:42.237673 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:42.413796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-304423a9-dd97-44b1-941c-9d17e9d7b418 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:42.415031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-304423a9-dd97-44b1-941c-9d17e9d7b418 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:42.424976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-304423a9-dd97-44b1-941c-9d17e9d7b418 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:42.425447 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-304423a9-dd97-44b1-941c-9d17e9d7b418 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:42.426442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-304423a9-dd97-44b1-941c-9d17e9d7b418 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:42.427196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-304423a9-dd97-44b1-941c-9d17e9d7b418 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:42.499063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:42.517778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:42.526466 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:42.528390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ee1219b8-e519-456f-9bf9-69c8edec0704 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.315300 Dec 03 15:08:42.529302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 430/833] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:42 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:42.596391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-304423a9-dd97-44b1-941c-9d17e9d7b418 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 38272 microversion: 2.1 time: 0.191854 Dec 03 15:08:42.602467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 404/834] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:42 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 38272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:43.012906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a99c93d6-1b6d-4a52-9b33-49c33e45157b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:43.013990 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a99c93d6-1b6d-4a52-9b33-49c33e45157b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:43.022071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a99c93d6-1b6d-4a52-9b33-49c33e45157b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:43.022694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a99c93d6-1b6d-4a52-9b33-49c33e45157b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:43.023636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a99c93d6-1b6d-4a52-9b33-49c33e45157b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:43.024223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a99c93d6-1b6d-4a52-9b33-49c33e45157b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:43.302929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a99c93d6-1b6d-4a52-9b33-49c33e45157b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:43.314257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a99c93d6-1b6d-4a52-9b33-49c33e45157b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.311089 Dec 03 15:08:43.315251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 431/835] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:43 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:43.557870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:43.558958 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:43.569287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:43.569856 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:43.571881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:43.572552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:43.616103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-abf750e6-6122-45f5-8f84-d465d3aa0ddb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:43.622058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-abf750e6-6122-45f5-8f84-d465d3aa0ddb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:43.631043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abf750e6-6122-45f5-8f84-d465d3aa0ddb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:43.631557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abf750e6-6122-45f5-8f84-d465d3aa0ddb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:43.632420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abf750e6-6122-45f5-8f84-d465d3aa0ddb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:43.632918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-abf750e6-6122-45f5-8f84-d465d3aa0ddb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:43.800520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-abf750e6-6122-45f5-8f84-d465d3aa0ddb tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action" status: 200 len: 38325 microversion: 2.1 time: 0.194093 Dec 03 15:08:43.801622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 432/836] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:43 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/action => generated 38325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:43.840356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-03b29274-1dfd-43cf-bc95-0c9f979dbef2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:43.845036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-03b29274-1dfd-43cf-bc95-0c9f979dbef2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:43.865698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03b29274-1dfd-43cf-bc95-0c9f979dbef2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:43.870360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03b29274-1dfd-43cf-bc95-0c9f979dbef2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:43.875935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:43.876510 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03b29274-1dfd-43cf-bc95-0c9f979dbef2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:43.878297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-03b29274-1dfd-43cf-bc95-0c9f979dbef2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:43.892518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:43.899028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:43.900555 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-72d88a8c-4d48-4916-9b7f-df4eec6cbdd8 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.354069 Dec 03 15:08:43.901443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 405/837] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:43 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:43.973481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-03b29274-1dfd-43cf-bc95-0c9f979dbef2 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/ips" status: 200 len: 146 microversion: 2.1 time: 0.158932 Dec 03 15:08:43.974325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 433/838] 10.222.0.63 () {58 vars in 1238 bytes} [Thu Dec 3 15:08:43 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/ips => generated 146 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:08:44.350313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0e05d49e-aa2d-4431-8a69-3dd77d4b36c6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:44.350851 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0e05d49e-aa2d-4431-8a69-3dd77d4b36c6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:44.360897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e05d49e-aa2d-4431-8a69-3dd77d4b36c6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:44.361409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e05d49e-aa2d-4431-8a69-3dd77d4b36c6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:44.365025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e05d49e-aa2d-4431-8a69-3dd77d4b36c6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:44.365025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0e05d49e-aa2d-4431-8a69-3dd77d4b36c6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:44.627298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0e05d49e-aa2d-4431-8a69-3dd77d4b36c6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:44.639727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0e05d49e-aa2d-4431-8a69-3dd77d4b36c6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.310302 Dec 03 15:08:44.640520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 406/839] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:44 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:44.929366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:44.929993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:44.939082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:44.939591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:44.940439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:44.940929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:45.216370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:45.233124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:45.240253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:45.241548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6c7d5cfe-3c45-4e24-9556-9b381548f59a tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.323321 Dec 03 15:08:45.242357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 434/840] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:44 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:45.665189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b13fab89-e840-4ea0-863b-8245e33c8f6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:45.666505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b13fab89-e840-4ea0-863b-8245e33c8f6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:45.682993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13fab89-e840-4ea0-863b-8245e33c8f6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:45.683795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13fab89-e840-4ea0-863b-8245e33c8f6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:45.684826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13fab89-e840-4ea0-863b-8245e33c8f6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:45.685503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13fab89-e840-4ea0-863b-8245e33c8f6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:45.688162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9123b424-67af-48c2-80ca-68f6c4db39c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b931093-601b-4d11-af62-49f6b2ad1a80"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:45.689363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9123b424-67af-48c2-80ca-68f6c4db39c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:45.702617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9123b424-67af-48c2-80ca-68f6c4db39c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:45.703117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9123b424-67af-48c2-80ca-68f6c4db39c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:45.703987 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9123b424-67af-48c2-80ca-68f6c4db39c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:45.704490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9123b424-67af-48c2-80ca-68f6c4db39c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:46.112384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b13fab89-e840-4ea0-863b-8245e33c8f6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:46.124043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b13fab89-e840-4ea0-863b-8245e33c8f6e tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1573 microversion: 2.1 time: 0.469278 Dec 03 15:08:46.125261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 407/841] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:45 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1573 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:46.271025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:46.272035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:46.294673 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:46.295184 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:46.296057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:46.296557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:46.403374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9123b424-67af-48c2-80ca-68f6c4db39c4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724444 Dec 03 15:08:46.405950 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 435/842] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:08:45 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments => generated 194 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:08:46.574285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:46.593222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:46.600962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:46.602441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-41f7035e-7533-4820-a9d2-e22beedb6aed tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.345288 Dec 03 15:08:46.603923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 408/843] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:46 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:47.151347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-488c0dd8-ab32-471d-b803-6edb4eee05f3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:47.152843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-488c0dd8-ab32-471d-b803-6edb4eee05f3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:47.162326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-488c0dd8-ab32-471d-b803-6edb4eee05f3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.162850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-488c0dd8-ab32-471d-b803-6edb4eee05f3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.163730 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-488c0dd8-ab32-471d-b803-6edb4eee05f3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.164235 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-488c0dd8-ab32-471d-b803-6edb4eee05f3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.255020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-56fb8c4a-2bf5-4aaf-9544-0911b87208a9 req-a1fd14ed-fb2a-4b71-8bf9-07d63615fa2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add146c2-e4cc-491e-b5f9-17673e4a0c89", "name": "network-vif-unplugged", "status": "completed", "tag": "f82f881d-f8f0-478d-baa4-3c020c077e99"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:47.272932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:08:47.272932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:08:47.284680 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-56fb8c4a-2bf5-4aaf-9544-0911b87208a9 req-a1fd14ed-fb2a-4b71-8bf9-07d63615fa2b service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.285622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-56fb8c4a-2bf5-4aaf-9544-0911b87208a9 req-a1fd14ed-fb2a-4b71-8bf9-07d63615fa2b service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.328257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-56fb8c4a-2bf5-4aaf-9544-0911b87208a9 req-a1fd14ed-fb2a-4b71-8bf9-07d63615fa2b service nova] Creating event network-vif-unplugged:f82f881d-f8f0-478d-baa4-3c020c077e99 for instance add146c2-e4cc-491e-b5f9-17673e4a0c89 on hv-cinder-75790 Dec 03 15:08:47.339702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-56fb8c4a-2bf5-4aaf-9544-0911b87208a9 req-a1fd14ed-fb2a-4b71-8bf9-07d63615fa2b service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113485 Dec 03 15:08:47.340356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 409/844] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:08:47 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:08:47.535922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-488c0dd8-ab32-471d-b803-6edb4eee05f3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:47.551069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-488c0dd8-ab32-471d-b803-6edb4eee05f3 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1574 microversion: 2.1 time: 0.412189 Dec 03 15:08:47.555453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 436/845] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:47 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1574 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:47.579358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9fd514fe-95bf-41d7-93f9-dc029cfb07fa tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:47.580185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9fd514fe-95bf-41d7-93f9-dc029cfb07fa tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:47.591303 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9fd514fe-95bf-41d7-93f9-dc029cfb07fa tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.591812 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9fd514fe-95bf-41d7-93f9-dc029cfb07fa tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.592735 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9fd514fe-95bf-41d7-93f9-dc029cfb07fa tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.593379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9fd514fe-95bf-41d7-93f9-dc029cfb07fa tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.630674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:47.631364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:47.641413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.641941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.642880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.643389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.824493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9fd514fe-95bf-41d7-93f9-dc029cfb07fa tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "POST /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89/action" status: 202 len: 0 microversion: 2.1 time: 0.257836 Dec 03 15:08:47.826008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 410/846] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:08:47 2020] POST /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:08:47.840835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-21280851-350b-40cb-8439-a6a7747aa6d6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:47.841035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-21280851-350b-40cb-8439-a6a7747aa6d6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:47.849491 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21280851-350b-40cb-8439-a6a7747aa6d6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.850095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21280851-350b-40cb-8439-a6a7747aa6d6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.851162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21280851-350b-40cb-8439-a6a7747aa6d6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:47.851418 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-21280851-350b-40cb-8439-a6a7747aa6d6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:47.953353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:47.970128 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:47.979226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:47.981254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d643956a-db26-42b2-be10-b862395109d4 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.362926 Dec 03 15:08:47.982157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 437/847] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:47 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:08:48.180163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-21280851-350b-40cb-8439-a6a7747aa6d6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:48.193565 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-21280851-350b-40cb-8439-a6a7747aa6d6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1522 microversion: 2.1 time: 0.363414 Dec 03 15:08:48.194228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 411/848] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:47 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:49.005635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:49.006342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:49.015020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:49.015525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:49.016368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:49.016863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:49.218766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-83bd200d-9a2a-483f-a69f-d1e7de67c283 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:49.219469 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-83bd200d-9a2a-483f-a69f-d1e7de67c283 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:49.227825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-83bd200d-9a2a-483f-a69f-d1e7de67c283 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:49.228926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-83bd200d-9a2a-483f-a69f-d1e7de67c283 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:49.229689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-83bd200d-9a2a-483f-a69f-d1e7de67c283 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:49.230607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-83bd200d-9a2a-483f-a69f-d1e7de67c283 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:49.243160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:49.260202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:49.270842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:49.272428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-dea408ae-fcc5-4b03-9a6d-d28daf6fc54e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1741 microversion: 2.20 time: 0.276256 Dec 03 15:08:49.273007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 438/849] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:48 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:49.472777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-83bd200d-9a2a-483f-a69f-d1e7de67c283 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:49.482575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-83bd200d-9a2a-483f-a69f-d1e7de67c283 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1524 microversion: 2.1 time: 0.273625 Dec 03 15:08:49.483190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 412/850] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:49 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1524 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:50.297845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:50.298574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:50.307477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:50.307997 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:50.308853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:50.309362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:50.508403 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-98e75426-c32a-4b63-82e4-d5cdaca7da43 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:50.509198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-98e75426-c32a-4b63-82e4-d5cdaca7da43 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:50.518366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98e75426-c32a-4b63-82e4-d5cdaca7da43 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:50.518862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98e75426-c32a-4b63-82e4-d5cdaca7da43 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:50.519928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98e75426-c32a-4b63-82e4-d5cdaca7da43 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:50.520431 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-98e75426-c32a-4b63-82e4-d5cdaca7da43 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:50.547330 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:50.563033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:50.569701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:50.570956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-745a80b3-64d6-4730-a3e2-d71f5efdb843 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1723 microversion: 2.20 time: 0.283056 Dec 03 15:08:50.571554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 439/851] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:50 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:50.756050 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-98e75426-c32a-4b63-82e4-d5cdaca7da43 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:50.765614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-98e75426-c32a-4b63-82e4-d5cdaca7da43 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1524 microversion: 2.1 time: 0.266705 Dec 03 15:08:50.766373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 413/852] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:50 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1524 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:51.596284 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:51.596868 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:51.605031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:51.605533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:51.606422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:51.606909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:51.789962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4e543bd6-efd4-4770-9b19-96d202ea889c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:51.791328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4e543bd6-efd4-4770-9b19-96d202ea889c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:51.800510 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e543bd6-efd4-4770-9b19-96d202ea889c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:51.801044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e543bd6-efd4-4770-9b19-96d202ea889c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:51.802033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e543bd6-efd4-4770-9b19-96d202ea889c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:51.805037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e543bd6-efd4-4770-9b19-96d202ea889c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:51.850419 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:51.865377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:51.872726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:51.873959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b1c33aba-ed2e-462c-8da1-1f1d3de1319e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1723 microversion: 2.20 time: 0.287157 Dec 03 15:08:51.874552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 440/853] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:51 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:52.034386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4e543bd6-efd4-4770-9b19-96d202ea889c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:52.043694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4e543bd6-efd4-4770-9b19-96d202ea889c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1524 microversion: 2.1 time: 0.262896 Dec 03 15:08:52.044300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 414/854] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:51 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1524 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:52.899849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:52.900741 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:52.909449 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:52.910378 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:52.911269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:52.911769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:53.068261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ba72c681-4cfc-4ed5-8310-aac366ea64ce tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:53.069383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ba72c681-4cfc-4ed5-8310-aac366ea64ce tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:53.077841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ba72c681-4cfc-4ed5-8310-aac366ea64ce tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:53.078385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ba72c681-4cfc-4ed5-8310-aac366ea64ce tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:53.079426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ba72c681-4cfc-4ed5-8310-aac366ea64ce tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:53.080107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ba72c681-4cfc-4ed5-8310-aac366ea64ce tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:53.169695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:53.202454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:53.209009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:53.213062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9913441c-975a-4686-b5ec-b1413699446f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1666 microversion: 2.20 time: 0.321079 Dec 03 15:08:53.213062 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 441/855] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:52 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1666 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:53.224007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-3724b09c-c6ba-4b66-9289-443dad2a925f req-4e80af95-f874-4164-8bb3-6294a433eb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2dedaf2-51f5-458f-8e08-7814bc6780c3", "name": "network-vif-unplugged", "status": "completed", "tag": "0b68efc4-0565-4c23-9acc-fbbc726bba64"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:53.232171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:08:53.232171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:08:53.242314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-3724b09c-c6ba-4b66-9289-443dad2a925f req-4e80af95-f874-4164-8bb3-6294a433eb3a service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:53.242877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-3724b09c-c6ba-4b66-9289-443dad2a925f req-4e80af95-f874-4164-8bb3-6294a433eb3a service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:53.261764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.compute.server_external_events [req-3724b09c-c6ba-4b66-9289-443dad2a925f req-4e80af95-f874-4164-8bb3-6294a433eb3a service nova] Unable to find a host for instance e2dedaf2-51f5-458f-8e08-7814bc6780c3. Dropping event network-vif-unplugged {{(pid=94374) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Dec 03 15:08:53.262373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-3724b09c-c6ba-4b66-9289-443dad2a925f req-4e80af95-f874-4164-8bb3-6294a433eb3a service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049039 Dec 03 15:08:53.263273 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 442/856] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:08:53 2020] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 03 15:08:53.273500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-72ad140f-c775-47c2-addc-8fb52e089461 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e42bd1b7-9cdd-4ab7-a4bb-7b08e3b23d31"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:53.274753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-72ad140f-c775-47c2-addc-8fb52e089461 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:53.282729 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-72ad140f-c775-47c2-addc-8fb52e089461 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:53.283238 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-72ad140f-c775-47c2-addc-8fb52e089461 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:53.284086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-72ad140f-c775-47c2-addc-8fb52e089461 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:53.284576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-72ad140f-c775-47c2-addc-8fb52e089461 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:53.333083 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ba72c681-4cfc-4ed5-8310-aac366ea64ce tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:53.342755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ba72c681-4cfc-4ed5-8310-aac366ea64ce tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1524 microversion: 2.1 time: 0.284170 Dec 03 15:08:53.343355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 415/857] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:53 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1524 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:53.758944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-72ad140f-c775-47c2-addc-8fb52e089461 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.494597 Dec 03 15:08:53.760219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 443/858] 10.222.0.63 () {62 vars in 1354 bytes} [Thu Dec 3 15:08:53 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/os-volume_attachments => generated 188 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 15:08:53.879885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a6294b84-a374-46fb-8813-81e654236dd1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:53.880377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a6294b84-a374-46fb-8813-81e654236dd1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:53.888955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a6294b84-a374-46fb-8813-81e654236dd1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:53.889471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a6294b84-a374-46fb-8813-81e654236dd1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:53.890402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a6294b84-a374-46fb-8813-81e654236dd1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:53.890905 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a6294b84-a374-46fb-8813-81e654236dd1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.366502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-256b3334-33c9-4b81-b879-086b7e0214b7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:54.367189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-256b3334-33c9-4b81-b879-086b7e0214b7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:54.375390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-256b3334-33c9-4b81-b879-086b7e0214b7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.375906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-256b3334-33c9-4b81-b879-086b7e0214b7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.376773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-256b3334-33c9-4b81-b879-086b7e0214b7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.377274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-256b3334-33c9-4b81-b879-086b7e0214b7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.456985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a6294b84-a374-46fb-8813-81e654236dd1 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "DELETE /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/os-volume_attachments/e42bd1b7-9cdd-4ab7-a4bb-7b08e3b23d31" status: 202 len: 0 microversion: 2.20 time: 0.586946 Dec 03 15:08:54.457939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 416/859] 10.222.0.63 () {60 vars in 1447 bytes} [Thu Dec 3 15:08:53 2020] DELETE /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/os-volume_attachments/e42bd1b7-9cdd-4ab7-a4bb-7b08e3b23d31 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:08:54.472000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f51a0f3e-794d-4e19-9f8c-835662dbe64b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:54.473142 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f51a0f3e-794d-4e19-9f8c-835662dbe64b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:54.482908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f51a0f3e-794d-4e19-9f8c-835662dbe64b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.483425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f51a0f3e-794d-4e19-9f8c-835662dbe64b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.484280 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f51a0f3e-794d-4e19-9f8c-835662dbe64b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.484780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f51a0f3e-794d-4e19-9f8c-835662dbe64b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.560428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f51a0f3e-794d-4e19-9f8c-835662dbe64b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097977 Dec 03 15:08:54.561379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 417/860] 10.222.0.63 () {58 vars in 1292 bytes} [Thu Dec 3 15:08:54 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:08:54.577948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-87c0c7d6-5892-4fb8-af3a-faf527225208 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:54.578492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-87c0c7d6-5892-4fb8-af3a-faf527225208 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:54.589096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87c0c7d6-5892-4fb8-af3a-faf527225208 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.589977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87c0c7d6-5892-4fb8-af3a-faf527225208 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.591073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87c0c7d6-5892-4fb8-af3a-faf527225208 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.591791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-87c0c7d6-5892-4fb8-af3a-faf527225208 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.645444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-256b3334-33c9-4b81-b879-086b7e0214b7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:54.655439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-256b3334-33c9-4b81-b879-086b7e0214b7 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1524 microversion: 2.1 time: 0.298158 Dec 03 15:08:54.656037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 444/861] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:54 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1524 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:54.668059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fca68725-8de9-4c3a-9b05-197434faef99 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:54.668687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fca68725-8de9-4c3a-9b05-197434faef99 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:54.676788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fca68725-8de9-4c3a-9b05-197434faef99 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.677299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fca68725-8de9-4c3a-9b05-197434faef99 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.678177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fca68725-8de9-4c3a-9b05-197434faef99 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.678674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fca68725-8de9-4c3a-9b05-197434faef99 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.679765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-87c0c7d6-5892-4fb8-af3a-faf527225208 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/4b931093-601b-4d11-af62-49f6b2ad1a80" status: 200 len: 194 microversion: 2.1 time: 0.112170 Dec 03 15:08:54.680584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 418/862] 10.222.0.63 () {58 vars in 1403 bytes} [Thu Dec 3 15:08:54 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/4b931093-601b-4d11-af62-49f6b2ad1a80 => generated 194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:08:54.854758 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fca68725-8de9-4c3a-9b05-197434faef99 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action" status: 202 len: 0 microversion: 2.20 time: 0.197377 Dec 03 15:08:54.855440 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 445/863] 10.222.0.63 () {62 vars in 1309 bytes} [Thu Dec 3 15:08:54 2020] POST /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:08:54.872530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:54.873439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:54.887986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.888588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:54.890213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:54.890829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:55.357286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:55.373598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:55.380662 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:55.381883 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-02ce35a7-653f-4546-8a3d-1e194fb54acb tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1674 microversion: 2.20 time: 0.521990 Dec 03 15:08:55.382665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 419/864] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:54 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1674 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:55.680200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6e8271ba-4f1d-4f42-9215-891319e0d48c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:55.680965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6e8271ba-4f1d-4f42-9215-891319e0d48c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:55.690488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e8271ba-4f1d-4f42-9215-891319e0d48c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:55.691099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e8271ba-4f1d-4f42-9215-891319e0d48c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:55.692045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e8271ba-4f1d-4f42-9215-891319e0d48c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:55.692622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6e8271ba-4f1d-4f42-9215-891319e0d48c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:56.069041 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6e8271ba-4f1d-4f42-9215-891319e0d48c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:56.078045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6e8271ba-4f1d-4f42-9215-891319e0d48c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1524 microversion: 2.1 time: 0.407216 Dec 03 15:08:56.078658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 446/865] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:55 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1524 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:56.329420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-380b21c0-fb82-496f-9445-1964faba3bcc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0c5f754-4a71-4b64-b147-4c899618b89e"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:08:56.330573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-380b21c0-fb82-496f-9445-1964faba3bcc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:56.339270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-380b21c0-fb82-496f-9445-1964faba3bcc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:56.339773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-380b21c0-fb82-496f-9445-1964faba3bcc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:56.340622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-380b21c0-fb82-496f-9445-1964faba3bcc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:56.341114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-380b21c0-fb82-496f-9445-1964faba3bcc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:56.406978 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:56.407626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:56.417349 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:56.417866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:56.418740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:56.419233 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:56.781131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-380b21c0-fb82-496f-9445-1964faba3bcc tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461541 Dec 03 15:08:56.781974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 420/866] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:08:56 2020] POST /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:08:56.801252 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:56.824954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:56.831914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:56.833348 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-445d514b-9c21-4404-926c-942e87cbe31e tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1676 microversion: 2.20 time: 0.435478 Dec 03 15:08:56.834002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 447/867] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:56 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1676 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 15:08:57.103430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f0af3d61-a623-493a-ad6b-6ecb7852fbfc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:57.104288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f0af3d61-a623-493a-ad6b-6ecb7852fbfc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:57.113546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0af3d61-a623-493a-ad6b-6ecb7852fbfc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:57.114162 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0af3d61-a623-493a-ad6b-6ecb7852fbfc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:57.114963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0af3d61-a623-493a-ad6b-6ecb7852fbfc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:57.115463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f0af3d61-a623-493a-ad6b-6ecb7852fbfc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:57.342558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f0af3d61-a623-493a-ad6b-6ecb7852fbfc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:57.352275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f0af3d61-a623-493a-ad6b-6ecb7852fbfc tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.258864 Dec 03 15:08:57.353107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 421/868] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:57 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:57.860922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:57.861504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:57.870813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:57.871663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:57.872784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:57.873430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:58.238967 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:58.255527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:58.262881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:58.264161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-050d5c2e-195f-4bbf-8cf8-bee182fe085c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.413197 Dec 03 15:08:58.264762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 448/869] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:57 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:58.376359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-df33f326-f69c-488c-817d-d50a87c84c47 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:58.376952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-df33f326-f69c-488c-817d-d50a87c84c47 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:58.385638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df33f326-f69c-488c-817d-d50a87c84c47 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:58.386188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df33f326-f69c-488c-817d-d50a87c84c47 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:58.387059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df33f326-f69c-488c-817d-d50a87c84c47 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:58.387552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df33f326-f69c-488c-817d-d50a87c84c47 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:58.620836 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-df33f326-f69c-488c-817d-d50a87c84c47 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:58.630559 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-df33f326-f69c-488c-817d-d50a87c84c47 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.263377 Dec 03 15:08:58.631139 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 422/870] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:58 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:08:59.289863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:59.292410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:59.309698 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:59.310333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:59.311302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:59.311816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:59.545369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:59.563284 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:59.579377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:08:59.580909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c7d47c6a-22d9-4018-a5ee-bee0fda708e6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.300262 Dec 03 15:08:59.581481 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 449/871] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:08:59 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:08:59.655650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f4410629-c368-44b3-b6ab-295b1085c062 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:08:59.663573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f4410629-c368-44b3-b6ab-295b1085c062 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:08:59.672778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f4410629-c368-44b3-b6ab-295b1085c062 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:59.673293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f4410629-c368-44b3-b6ab-295b1085c062 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:08:59.674199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f4410629-c368-44b3-b6ab-295b1085c062 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:08:59.674711 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f4410629-c368-44b3-b6ab-295b1085c062 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:00.030222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f4410629-c368-44b3-b6ab-295b1085c062 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:00.039485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f4410629-c368-44b3-b6ab-295b1085c062 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.394273 Dec 03 15:09:00.040171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 423/872] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:08:59 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:00.607755 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:00.608547 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:00.617092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:00.617727 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:00.618768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:00.619382 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:00.918335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:00.952909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:00.959630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:00.960859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-404ebfab-a72f-41ad-a6bf-c5bf4eb33c57 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.364446 Dec 03 15:09:00.961449 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 450/873] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:00 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:01.065881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b38930cb-c2e1-4440-a235-0adc587af908 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:01.066699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b38930cb-c2e1-4440-a235-0adc587af908 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:01.076786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b38930cb-c2e1-4440-a235-0adc587af908 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:01.077341 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b38930cb-c2e1-4440-a235-0adc587af908 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:01.078227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b38930cb-c2e1-4440-a235-0adc587af908 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:01.078723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b38930cb-c2e1-4440-a235-0adc587af908 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:01.332310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b38930cb-c2e1-4440-a235-0adc587af908 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:01.341712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b38930cb-c2e1-4440-a235-0adc587af908 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.287263 Dec 03 15:09:01.342579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 424/874] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:01 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:01.989425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:02.010307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:02.021266 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:02.021777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:02.022665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:02.023167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:02.289475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:02.304937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:02.312697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:02.313853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2738fd81-6228-4a49-9821-208ad57fc37c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.335618 Dec 03 15:09:02.314482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 451/875] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:01 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:02.365297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-46120130-c8f9-476a-ba48-213658363be6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:02.366003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-46120130-c8f9-476a-ba48-213658363be6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:02.374125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-46120130-c8f9-476a-ba48-213658363be6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:02.374705 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-46120130-c8f9-476a-ba48-213658363be6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:02.375571 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-46120130-c8f9-476a-ba48-213658363be6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:02.376073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-46120130-c8f9-476a-ba48-213658363be6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:02.612593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-46120130-c8f9-476a-ba48-213658363be6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:02.623059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-46120130-c8f9-476a-ba48-213658363be6 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.266905 Dec 03 15:09:02.624023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 425/876] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:02 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:03.342308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:03.350776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:03.365933 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:03.366464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:03.367326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:03.367824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:03.610575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:03.646920 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:03.647583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-584fcd53-2762-49da-8268-67310392f9c9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:03.648269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-584fcd53-2762-49da-8268-67310392f9c9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:03.657071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-584fcd53-2762-49da-8268-67310392f9c9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:03.657596 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-584fcd53-2762-49da-8268-67310392f9c9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:03.658467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-584fcd53-2762-49da-8268-67310392f9c9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:03.659179 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-584fcd53-2762-49da-8268-67310392f9c9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:03.659463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:03.660720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2b9afbf1-4788-451d-8264-0348c64ac3ee tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.329698 Dec 03 15:09:03.661315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 452/877] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:03 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:03.966462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-584fcd53-2762-49da-8268-67310392f9c9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:03.977624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-584fcd53-2762-49da-8268-67310392f9c9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.339647 Dec 03 15:09:03.979180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 426/878] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:03 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:04.687878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:04.688536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:04.699518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:04.700105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:04.700977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:04.701991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:04.953474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:04.969420 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:04.976091 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:04.977329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a1bfa7f0-734c-46e3-9505-0db593eeb53f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.300488 Dec 03 15:09:04.977959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 453/879] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:04 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:05.002468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3fe3bd3b-d6fe-45b2-8017-8e833088d9c0 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:05.003226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3fe3bd3b-d6fe-45b2-8017-8e833088d9c0 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:05.012707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd3b-d6fe-45b2-8017-8e833088d9c0 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:05.013221 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd3b-d6fe-45b2-8017-8e833088d9c0 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:05.014114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd3b-d6fe-45b2-8017-8e833088d9c0 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:05.014613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd3b-d6fe-45b2-8017-8e833088d9c0 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:05.261844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3fe3bd3b-d6fe-45b2-8017-8e833088d9c0 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:05.270764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3fe3bd3b-d6fe-45b2-8017-8e833088d9c0 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.278271 Dec 03 15:09:05.271393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 427/880] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:04 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:06.002076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:06.002749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:06.023021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:06.023530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:06.024452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:06.025697 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:06.295766 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8e7ae39d-c7f6-4fa5-a429-964279e9b0cd tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:06.296367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8e7ae39d-c7f6-4fa5-a429-964279e9b0cd tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:06.306221 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8e7ae39d-c7f6-4fa5-a429-964279e9b0cd tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:06.307086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8e7ae39d-c7f6-4fa5-a429-964279e9b0cd tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:06.308007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8e7ae39d-c7f6-4fa5-a429-964279e9b0cd tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:06.308569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8e7ae39d-c7f6-4fa5-a429-964279e9b0cd tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:06.380714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:06.403224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:06.420849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:06.422132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b6ad6107-a008-43a1-8d96-54f517526e3b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.429314 Dec 03 15:09:06.423254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 454/881] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:05 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:06.563272 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8e7ae39d-c7f6-4fa5-a429-964279e9b0cd tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:06.572745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8e7ae39d-c7f6-4fa5-a429-964279e9b0cd tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.287552 Dec 03 15:09:06.573362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 428/882] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:06 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:07.447340 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:07.448610 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:07.457024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:07.457782 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:07.458980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:07.459820 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:07.598167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-97d2a245-8eb0-433e-8c77-2ac4b13ce26c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:07.604434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-97d2a245-8eb0-433e-8c77-2ac4b13ce26c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:07.612873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-97d2a245-8eb0-433e-8c77-2ac4b13ce26c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:07.613487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-97d2a245-8eb0-433e-8c77-2ac4b13ce26c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:07.614391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-97d2a245-8eb0-433e-8c77-2ac4b13ce26c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:07.614993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-97d2a245-8eb0-433e-8c77-2ac4b13ce26c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:07.733092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:07.753081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:07.776665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:07.777948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-acaafd16-1c9e-4c42-8426-e27feb55f605 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.340344 Dec 03 15:09:07.782477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 455/883] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:07 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:07.876678 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-97d2a245-8eb0-433e-8c77-2ac4b13ce26c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:07.887906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-97d2a245-8eb0-433e-8c77-2ac4b13ce26c tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.300575 Dec 03 15:09:07.888708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 429/884] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:07 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:08.802602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:08.803287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:08.812259 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:08.812771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:08.813624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:08.814174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:08.923258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d4133cec-b571-4897-9e48-1a2f969aba08 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:08.924365 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d4133cec-b571-4897-9e48-1a2f969aba08 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:08.935030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d4133cec-b571-4897-9e48-1a2f969aba08 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:08.935641 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d4133cec-b571-4897-9e48-1a2f969aba08 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:08.936794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d4133cec-b571-4897-9e48-1a2f969aba08 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:08.937295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d4133cec-b571-4897-9e48-1a2f969aba08 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:09.068767 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:09.086797 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:09.099465 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:09.101577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c7b4f873-3abd-4ff9-b7ae-fd19c0f6b2c6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.308740 Dec 03 15:09:09.105494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 456/885] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:08 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:09.194942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d4133cec-b571-4897-9e48-1a2f969aba08 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:09.204691 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d4133cec-b571-4897-9e48-1a2f969aba08 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.302041 Dec 03 15:09:09.205283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 430/886] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:08 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:09:10.134534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:10.135208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:10.143095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:10.143611 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:10.144460 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:10.145026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:10.231773 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-41a6a305-6bbb-4c78-92f5-595d13e0fc93 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:10.232446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-41a6a305-6bbb-4c78-92f5-595d13e0fc93 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:10.240560 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41a6a305-6bbb-4c78-92f5-595d13e0fc93 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:10.241072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41a6a305-6bbb-4c78-92f5-595d13e0fc93 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:10.241945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41a6a305-6bbb-4c78-92f5-595d13e0fc93 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:10.242446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41a6a305-6bbb-4c78-92f5-595d13e0fc93 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:10.380059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:10.395446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:10.403025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:10.404264 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-777a1432-f9b0-4c33-a722-fa447b48a79f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.279031 Dec 03 15:09:10.405071 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 457/887] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:10 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:10.617258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-41a6a305-6bbb-4c78-92f5-595d13e0fc93 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:10.629129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-41a6a305-6bbb-4c78-92f5-595d13e0fc93 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.407310 Dec 03 15:09:10.631150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 431/888] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:10 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:11.430526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:11.431865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:11.439725 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:11.440231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:11.441061 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:11.441554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:11.630451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0f18dc39-0975-406b-9f94-876b41f94344 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:11.631573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0f18dc39-0975-406b-9f94-876b41f94344 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:11.639790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0f18dc39-0975-406b-9f94-876b41f94344 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:11.640296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0f18dc39-0975-406b-9f94-876b41f94344 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:11.641149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0f18dc39-0975-406b-9f94-876b41f94344 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:11.641639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0f18dc39-0975-406b-9f94-876b41f94344 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:11.674881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:11.690625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:11.697745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:11.698979 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0dea5c54-db19-4333-938a-753ed1e66675 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.277692 Dec 03 15:09:11.705502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 458/889] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:11 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:11.709712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8228510c-4d1c-4657-b695-6785a7fb760b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:11.710413 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8228510c-4d1c-4657-b695-6785a7fb760b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:11.718085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0f18dc39-0975-406b-9f94-876b41f94344 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.096745 Dec 03 15:09:11.718882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 432/890] 10.222.0.63 () {58 vars in 1292 bytes} [Thu Dec 3 15:09:11 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:09:11.719407 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8228510c-4d1c-4657-b695-6785a7fb760b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:11.720007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8228510c-4d1c-4657-b695-6785a7fb760b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:11.720900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8228510c-4d1c-4657-b695-6785a7fb760b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:11.721406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8228510c-4d1c-4657-b695-6785a7fb760b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:11.971125 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8228510c-4d1c-4657-b695-6785a7fb760b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:11.980746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8228510c-4d1c-4657-b695-6785a7fb760b tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.279678 Dec 03 15:09:11.981511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 459/891] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:11 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:11.996444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8e728543-eab2-426f-9af5-786f17372548 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:11.996728 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-d5eb5b3f-1de9-490e-886b-04140a41e36c req-30299135-0672-457c-9abc-238857063623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add146c2-e4cc-491e-b5f9-17673e4a0c89", "name": "network-vif-plugged", "status": "completed", "tag": "f82f881d-f8f0-478d-baa4-3c020c077e99"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:11.997093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8e728543-eab2-426f-9af5-786f17372548 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:12.003513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:09:12.003513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:09:12.006056 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8e728543-eab2-426f-9af5-786f17372548 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:12.006639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8e728543-eab2-426f-9af5-786f17372548 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:12.007585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8e728543-eab2-426f-9af5-786f17372548 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:12.008147 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8e728543-eab2-426f-9af5-786f17372548 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:12.013065 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d5eb5b3f-1de9-490e-886b-04140a41e36c req-30299135-0672-457c-9abc-238857063623 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:12.013563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-d5eb5b3f-1de9-490e-886b-04140a41e36c req-30299135-0672-457c-9abc-238857063623 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:12.032212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-d5eb5b3f-1de9-490e-886b-04140a41e36c req-30299135-0672-457c-9abc-238857063623 service nova] Creating event network-vif-plugged:f82f881d-f8f0-478d-baa4-3c020c077e99 for instance add146c2-e4cc-491e-b5f9-17673e4a0c89 on hv-cinder-75790 Dec 03 15:09:12.037700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-d5eb5b3f-1de9-490e-886b-04140a41e36c req-30299135-0672-457c-9abc-238857063623 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054967 Dec 03 15:09:12.038470 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 460/892] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:09:11 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:09:12.090104 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8e728543-eab2-426f-9af5-786f17372548 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/4b931093-601b-4d11-af62-49f6b2ad1a80" status: 200 len: 194 microversion: 2.1 time: 0.112411 Dec 03 15:09:12.090770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 433/893] 10.222.0.63 () {58 vars in 1403 bytes} [Thu Dec 3 15:09:11 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/4b931093-601b-4d11-af62-49f6b2ad1a80 => generated 194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:09:12.107202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7b4a076b-5225-4ff8-9bcc-4611a6b1df2d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:12.107847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7b4a076b-5225-4ff8-9bcc-4611a6b1df2d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:12.116166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7b4a076b-5225-4ff8-9bcc-4611a6b1df2d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:12.116669 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7b4a076b-5225-4ff8-9bcc-4611a6b1df2d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:12.117534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7b4a076b-5225-4ff8-9bcc-4611a6b1df2d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:12.118055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7b4a076b-5225-4ff8-9bcc-4611a6b1df2d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:12.406344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7b4a076b-5225-4ff8-9bcc-4611a6b1df2d tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/4b931093-601b-4d11-af62-49f6b2ad1a80" status: 202 len: 0 microversion: 2.1 time: 0.308826 Dec 03 15:09:12.407000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 461/894] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:09:12 2020] DELETE /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/4b931093-601b-4d11-af62-49f6b2ad1a80 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:09:12.724514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:12.725103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:12.734287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:12.734799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:12.735646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:12.736143 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:12.968947 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:12.985360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:12.991970 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:12.993173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-31654077-0680-4db1-a133-2e9401c036ab tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.278209 Dec 03 15:09:13.002960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 434/895] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:12 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:13.006860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d084ac40-8b23-4b70-ae38-019d2d2d8a31 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:13.007620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d084ac40-8b23-4b70-ae38-019d2d2d8a31 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:13.017082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d084ac40-8b23-4b70-ae38-019d2d2d8a31 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:13.017603 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d084ac40-8b23-4b70-ae38-019d2d2d8a31 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:13.018515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d084ac40-8b23-4b70-ae38-019d2d2d8a31 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:13.019020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d084ac40-8b23-4b70-ae38-019d2d2d8a31 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:13.240370 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d084ac40-8b23-4b70-ae38-019d2d2d8a31 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:13.249738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d084ac40-8b23-4b70-ae38-019d2d2d8a31 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1580 microversion: 2.1 time: 0.252914 Dec 03 15:09:13.250391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 462/896] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:12 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1580 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:09:14.017959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:14.018648 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:14.027824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.028314 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:14.029154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.029650 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:14.274086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-86039f6f-6ad3-4656-b71c-993992a60c41 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:14.275103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-86039f6f-6ad3-4656-b71c-993992a60c41 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:14.285208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86039f6f-6ad3-4656-b71c-993992a60c41 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.286295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86039f6f-6ad3-4656-b71c-993992a60c41 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:14.287391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86039f6f-6ad3-4656-b71c-993992a60c41 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.288709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86039f6f-6ad3-4656-b71c-993992a60c41 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:14.297293 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:14.313296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:14.320388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:14.321815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2ad695d6-9095-46bf-95dc-22d7ad5822e9 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.313331 Dec 03 15:09:14.322646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 435/897] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:14 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:14.518234 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-19f89321-5797-4dfb-9707-f033fcdc8cd0 req-d46cc747-f20b-422b-bc75-e47cff237fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2dedaf2-51f5-458f-8e08-7814bc6780c3", "name": "network-vif-plugged", "status": "completed", "tag": "0b68efc4-0565-4c23-9acc-fbbc726bba64"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:14.525963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:09:14.525963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:09:14.535517 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-19f89321-5797-4dfb-9707-f033fcdc8cd0 req-d46cc747-f20b-422b-bc75-e47cff237fa4 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.536092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-19f89321-5797-4dfb-9707-f033fcdc8cd0 req-d46cc747-f20b-422b-bc75-e47cff237fa4 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:14.539013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-86039f6f-6ad3-4656-b71c-993992a60c41 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:14.550495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-86039f6f-6ad3-4656-b71c-993992a60c41 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1567 microversion: 2.1 time: 0.286293 Dec 03 15:09:14.551330 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 463/898] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:14 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:14.554966 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-19f89321-5797-4dfb-9707-f033fcdc8cd0 req-d46cc747-f20b-422b-bc75-e47cff237fa4 service nova] Creating event network-vif-plugged:0b68efc4-0565-4c23-9acc-fbbc726bba64 for instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 on hv-cinder-75790 Dec 03 15:09:14.561051 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-19f89321-5797-4dfb-9707-f033fcdc8cd0 req-d46cc747-f20b-422b-bc75-e47cff237fa4 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056062 Dec 03 15:09:14.562030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 436/899] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:09:14 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:09:14.741690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-39f5d5ad-fe1e-49b1-8776-2e48a4b4f955 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:14.742267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-39f5d5ad-fe1e-49b1-8776-2e48a4b4f955 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:14.765862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-39f5d5ad-fe1e-49b1-8776-2e48a4b4f955 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.768647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-39f5d5ad-fe1e-49b1-8776-2e48a4b4f955 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:14.769685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-39f5d5ad-fe1e-49b1-8776-2e48a4b4f955 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.770304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-39f5d5ad-fe1e-49b1-8776-2e48a4b4f955 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:14.851513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-39f5d5ad-fe1e-49b1-8776-2e48a4b4f955 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/d0c5f754-4a71-4b64-b147-4c899618b89e" status: 200 len: 194 microversion: 2.1 time: 0.119273 Dec 03 15:09:14.852170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 464/900] 10.222.0.63 () {58 vars in 1403 bytes} [Thu Dec 3 15:09:14 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/d0c5f754-4a71-4b64-b147-4c899618b89e => generated 194 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:09:14.869428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d6488d22-6499-4bcc-b2dc-bc9247dbaa90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:14.870132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d6488d22-6499-4bcc-b2dc-bc9247dbaa90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:14.880937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d6488d22-6499-4bcc-b2dc-bc9247dbaa90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.881453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d6488d22-6499-4bcc-b2dc-bc9247dbaa90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:14.882350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d6488d22-6499-4bcc-b2dc-bc9247dbaa90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:14.882857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d6488d22-6499-4bcc-b2dc-bc9247dbaa90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:15.168379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d6488d22-6499-4bcc-b2dc-bc9247dbaa90 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/d0c5f754-4a71-4b64-b147-4c899618b89e" status: 202 len: 0 microversion: 2.1 time: 0.309147 Dec 03 15:09:15.169060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 437/901] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:09:14 2020] DELETE /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293/os-volume_attachments/d0c5f754-4a71-4b64-b147-4c899618b89e => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:09:15.346730 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:15.347396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:15.356288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:15.356798 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:15.357663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:15.358203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:15.582637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:15.598569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:15.606323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:15.607546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0bff0924-0a43-47e0-a1c1-fa93ea9dd87d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.270798 Dec 03 15:09:15.608311 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 465/902] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:15 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:16.633033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:16.634107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:16.644524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:16.645038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:16.645945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:16.646434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:16.979931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:17.000186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:17.010427 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:17.012395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4feba5da-2fff-4785-9512-732ce3e8fdd6 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1732 microversion: 2.20 time: 0.389337 Dec 03 15:09:17.013169 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 438/903] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:16 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1732 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:17.047700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0effb417-01e8-44e1-9411-e191d68bcb20 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:17.048776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0effb417-01e8-44e1-9411-e191d68bcb20 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:17.060989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0effb417-01e8-44e1-9411-e191d68bcb20 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:17.061502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0effb417-01e8-44e1-9411-e191d68bcb20 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:17.062401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0effb417-01e8-44e1-9411-e191d68bcb20 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:17.062891 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0effb417-01e8-44e1-9411-e191d68bcb20 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:17.153576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0effb417-01e8-44e1-9411-e191d68bcb20 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:09:17.285875 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0effb417-01e8-44e1-9411-e191d68bcb20 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 204 len: 0 microversion: 2.1 time: 0.250080 Dec 03 15:09:17.287386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 466/904] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:09:17 2020] DELETE /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:09:17.302525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2186d5fd-52c1-4726-9ec6-df279596f2e4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:17.303327 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2186d5fd-52c1-4726-9ec6-df279596f2e4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:17.316231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2186d5fd-52c1-4726-9ec6-df279596f2e4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:17.316922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2186d5fd-52c1-4726-9ec6-df279596f2e4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:17.317872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2186d5fd-52c1-4726-9ec6-df279596f2e4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:17.318542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2186d5fd-52c1-4726-9ec6-df279596f2e4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:17.593409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2186d5fd-52c1-4726-9ec6-df279596f2e4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:17.605641 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2186d5fd-52c1-4726-9ec6-df279596f2e4 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1675 microversion: 2.1 time: 0.313046 Dec 03 15:09:17.606406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 439/905] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:17 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1675 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:09:18.044342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:18.045203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:18.054255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:18.054771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:18.055639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:18.056137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:18.501369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:18.518399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:18.525044 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:18.527220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bb1f7261-d5c3-4497-913b-8cce409e34ae tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1719 microversion: 2.20 time: 0.493076 Dec 03 15:09:18.527826 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 467/906] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:18 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1719 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:18.631583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e6c5562d-d94c-4d93-bf13-69f17d6ec487 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:18.632258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e6c5562d-d94c-4d93-bf13-69f17d6ec487 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:18.641055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6c5562d-d94c-4d93-bf13-69f17d6ec487 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:18.641563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6c5562d-d94c-4d93-bf13-69f17d6ec487 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:18.642429 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6c5562d-d94c-4d93-bf13-69f17d6ec487 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:18.642927 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6c5562d-d94c-4d93-bf13-69f17d6ec487 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:18.873226 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e6c5562d-d94c-4d93-bf13-69f17d6ec487 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:18.882688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e6c5562d-d94c-4d93-bf13-69f17d6ec487 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1675 microversion: 2.1 time: 0.260195 Dec 03 15:09:18.884312 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 440/907] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:18 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1675 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:19.908616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a1bf1bdb-31bc-49e5-8f7e-7d038be67447 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:19.909285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a1bf1bdb-31bc-49e5-8f7e-7d038be67447 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:19.917448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1bf1bdb-31bc-49e5-8f7e-7d038be67447 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:19.917984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1bf1bdb-31bc-49e5-8f7e-7d038be67447 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:19.919145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1bf1bdb-31bc-49e5-8f7e-7d038be67447 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:19.919657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1bf1bdb-31bc-49e5-8f7e-7d038be67447 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:20.426216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a1bf1bdb-31bc-49e5-8f7e-7d038be67447 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:20.436986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a1bf1bdb-31bc-49e5-8f7e-7d038be67447 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1675 microversion: 2.1 time: 0.537892 Dec 03 15:09:20.437757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 468/908] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:19 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1675 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:21.319178 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-55ab8875-76e3-4c50-a630-563c410a7d98 req-b0277e03-a56a-40a9-b617-9d7cfddc9833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dd50c1-fa7d-4a82-8f53-f9cd544b4293", "name": "network-vif-deleted", "tag": "b56e789b-5833-4289-8ccf-0c42d598a9bf"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:21.331190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:09:21.331190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:09:21.348393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-55ab8875-76e3-4c50-a630-563c410a7d98 req-b0277e03-a56a-40a9-b617-9d7cfddc9833 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:21.349471 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-55ab8875-76e3-4c50-a630-563c410a7d98 req-b0277e03-a56a-40a9-b617-9d7cfddc9833 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:21.371215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-55ab8875-76e3-4c50-a630-563c410a7d98 req-b0277e03-a56a-40a9-b617-9d7cfddc9833 service nova] Creating event network-vif-deleted:b56e789b-5833-4289-8ccf-0c42d598a9bf for instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 on hv-cinder-75790 Dec 03 15:09:21.376305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-55ab8875-76e3-4c50-a630-563c410a7d98 req-b0277e03-a56a-40a9-b617-9d7cfddc9833 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066381 Dec 03 15:09:21.376946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 441/909] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:09:21 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:09:21.461962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:21.463339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:21.472435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:21.473193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:21.474135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:21.474692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:21.559015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:21.559531 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:21.560049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lazy-loading 'fault' on Instance uuid d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:09:21.644845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a3fdb0a0c44f6bdebf91a5d4e77b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf6d3149aee44a798e51e0135d17c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:21.654537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b0b1075a-e065-4e55-a020-5ac06bc2117b tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 200 len: 1328 microversion: 2.1 time: 0.202267 Dec 03 15:09:21.655151 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 469/910] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:21 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 1328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:22.680134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:22.680918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:22.690690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:22.691207 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:22.692059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:22.692558 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:22.747929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] HTTP exception thrown: Instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 could not be found. Dec 03 15:09:22.748594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Returning 404 to user: Instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:22.749500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-20b593b7-9d0f-49cf-96ae-06015603f819 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 404 len: 111 microversion: 2.1 time: 0.079170 Dec 03 15:09:22.754585 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 442/911] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:22 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:09:22.777242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cf348ba8-bffe-4e1d-bd48-3a6fe9432af5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '.version_select at 0x7fd5f567a9d8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:22.800775 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cf348ba8-bffe-4e1d-bd48-3a6fe9432af5 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117614595" status: 202 len: 0 microversion: 2.1 time: 0.045323 Dec 03 15:09:22.801757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 470/912] 10.222.0.63 () {58 vars in 1211 bytes} [Thu Dec 3 15:09:22 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117614595 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:09:26.570034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:26.570593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:26.579617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:26.580138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:26.581005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:26.581507 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:26.635369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] HTTP exception thrown: Instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 could not be found. Dec 03 15:09:26.636132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Returning 404 to user: Instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:26.637033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6a4f0939-9e09-43ca-afa1-a5a188e0ac49 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 404 len: 111 microversion: 2.1 time: 0.076353 Dec 03 15:09:26.637640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 443/913] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:09:26 2020] DELETE /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:09:26.651467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:26.652140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d2dd50c1-fa7d-4a82-8f53-f9cd544b4293] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:26.664015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:26.664586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:26.665433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:26.666302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:26.719377 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] HTTP exception thrown: Instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 could not be found. Dec 03 15:09:26.719955 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Returning 404 to user: Instance d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:26.720847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-16eb1228-b3c3-41f8-a4e2-5ba444249793 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293" status: 404 len: 111 microversion: 2.1 time: 0.078732 Dec 03 15:09:26.721458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 471/914] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:26 2020] GET /compute/v2.1/servers/d2dd50c1-fa7d-4a82-8f53-f9cd544b4293 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:09:27.977183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:27.977712 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:27.985900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:27.986437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:27.987277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:27.987762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:28.045576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] HTTP exception thrown: Instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 could not be found. Dec 03 15:09:28.046385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Returning 404 to user: Instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:28.047312 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f8e4fadc-d6bc-48e6-b478-51d83cded74e tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "DELETE /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 404 len: 111 microversion: 2.1 time: 0.079241 Dec 03 15:09:28.047973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 444/915] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:09:27 2020] DELETE /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:09:28.063166 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:28.063942 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] [instance: d5082cea-6dd3-41d3-9210-f5e8bd37f651] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:28.073057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:28.074101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:28.075288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:28.076214 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:28.142502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] HTTP exception thrown: Instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 could not be found. Dec 03 15:09:28.143150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] Returning 404 to user: Instance d5082cea-6dd3-41d3-9210-f5e8bd37f651 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:28.144265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1178c792-e044-40c3-8eaa-42c8dafafe25 tempest-AttachVolumeTestJSON-424615299 tempest-AttachVolumeTestJSON-424615299] 10.222.0.63 "GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651" status: 404 len: 111 microversion: 2.1 time: 0.091807 Dec 03 15:09:28.144867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 472/916] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:09:28 2020] GET /compute/v2.1/servers/d5082cea-6dd3-41d3-9210-f5e8bd37f651 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:09:36.811738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-43147ec5-9a8f-4bea-8d6a-381cb047c4f7 tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Action: 'create', calling method: .version_select at 0x7fd5f7328d90>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-419622209", "metadata": {"Type": "work"}}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:36.813758 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-43147ec5-9a8f-4bea-8d6a-381cb047c4f7 tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:36.814335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-43147ec5-9a8f-4bea-8d6a-381cb047c4f7 tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] 10.222.0.63 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.169511 Dec 03 15:09:36.815271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 445/917] 10.222.0.63 () {60 vars in 1146 bytes} [Thu Dec 3 15:09:36 2020] POST /compute/v2.1/os-volumes => generated 127 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 03 15:09:36.830740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-279ce989-443a-4e56-8e7b-e26d9964d90a tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Action: 'create', calling method: .version_select at 0x7fd5f572e730>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1622914129", "metadata": {"Type": "work"}}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:36.832607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-279ce989-443a-4e56-8e7b-e26d9964d90a tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:36.833563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-279ce989-443a-4e56-8e7b-e26d9964d90a tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] 10.222.0.63 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012615 Dec 03 15:09:36.834492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 473/918] 10.222.0.63 () {60 vars in 1146 bytes} [Thu Dec 3 15:09:36 2020] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 03 15:09:36.851380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-dcc592cc-6496-4736-9182-f7417fc8c1cc tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Action: 'create', calling method: .version_select at 0x7fd5f7229268>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1970776217", "metadata": {"Type": "work"}}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:36.853067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-dcc592cc-6496-4736-9182-f7417fc8c1cc tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:36.854986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-dcc592cc-6496-4736-9182-f7417fc8c1cc tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] 10.222.0.63 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013736 Dec 03 15:09:36.856005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 446/919] 10.222.0.63 () {60 vars in 1146 bytes} [Thu Dec 3 15:09:36 2020] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 03 15:09:36.873122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a3a1a901-9ba6-4ff3-be2f-bcc49aa19e7a tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Calling method '.version_select at 0x7fd5f5703510>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:36.959363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-a3a1a901-9ba6-4ff3-be2f-bcc49aa19e7a tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] HTTP exception thrown: Volume tempest-invalid-673046425 could not be found. Dec 03 15:09:36.960026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a3a1a901-9ba6-4ff3-be2f-bcc49aa19e7a tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Returning 404 to user: Volume tempest-invalid-673046425 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:36.960918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a3a1a901-9ba6-4ff3-be2f-bcc49aa19e7a tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] 10.222.0.63 "DELETE /compute/v2.1/os-volumes/tempest-invalid-673046425" status: 404 len: 98 microversion: 2.1 time: 0.098925 Dec 03 15:09:36.961524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 474/920] 10.222.0.63 () {58 vars in 1205 bytes} [Thu Dec 3 15:09:36 2020] DELETE /compute/v2.1/os-volumes/tempest-invalid-673046425 => generated 98 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 03 15:09:36.977530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ae9168ce-7d15-4215-b6d2-6ea24a91059b tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] 10.222.0.63 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009593 Dec 03 15:09:36.978188 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 447/921] 10.222.0.63 () {58 vars in 1130 bytes} [Thu Dec 3 15:09:36 2020] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 03 15:09:36.992762 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9fd63530-08df-4674-b45e-3cdf4c449d88 tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] 10.222.0.63 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008863 Dec 03 15:09:36.993307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 475/922] 10.222.0.63 () {58 vars in 1127 bytes} [Thu Dec 3 15:09:36 2020] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 03 15:09:37.008503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d86f24b2-5b7e-4f57-b715-b024aec4e2c6 tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Calling method '.version_select at 0x7fd5f7229ae8>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:37.082098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-d86f24b2-5b7e-4f57-b715-b024aec4e2c6 tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] HTTP exception thrown: Volume 11de6fef-89cd-44f3-9786-6f24fe45234b could not be found. Dec 03 15:09:37.082800 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d86f24b2-5b7e-4f57-b715-b024aec4e2c6 tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Returning 404 to user: Volume 11de6fef-89cd-44f3-9786-6f24fe45234b could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:37.083686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d86f24b2-5b7e-4f57-b715-b024aec4e2c6 tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] 10.222.0.63 "DELETE /compute/v2.1/os-volumes/11de6fef-89cd-44f3-9786-6f24fe45234b" status: 404 len: 109 microversion: 2.1 time: 0.084527 Dec 03 15:09:37.084276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 448/923] 10.222.0.63 () {58 vars in 1238 bytes} [Thu Dec 3 15:09:36 2020] DELETE /compute/v2.1/os-volumes/11de6fef-89cd-44f3-9786-6f24fe45234b => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:09:37.101161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a3bd8a3e-e98e-4298-b50d-e4df918e0f5f tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Calling method '.version_select at 0x7fd5f572eae8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:37.171739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-a3bd8a3e-e98e-4298-b50d-e4df918e0f5f tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] HTTP exception thrown: Volume f25998ac-d7db-4d29-8c8a-f819b39b1416 could not be found. Dec 03 15:09:37.172401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a3bd8a3e-e98e-4298-b50d-e4df918e0f5f tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] Returning 404 to user: Volume f25998ac-d7db-4d29-8c8a-f819b39b1416 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:09:37.173296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a3bd8a3e-e98e-4298-b50d-e4df918e0f5f tempest-VolumesNegativeTest-78745636 tempest-VolumesNegativeTest-78745636] 10.222.0.63 "GET /compute/v2.1/os-volumes/f25998ac-d7db-4d29-8c8a-f819b39b1416" status: 404 len: 109 microversion: 2.1 time: 0.081559 Dec 03 15:09:37.173899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 476/924] 10.222.0.63 () {58 vars in 1235 bytes} [Thu Dec 3 15:09:37 2020] GET /compute/v2.1/os-volumes/f25998ac-d7db-4d29-8c8a-f819b39b1416 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:09:56.776694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2801227d-27d7-4cd8-a799-e9a9304ddf28 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: .version_select at 0x7fd5f69e4620>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-415978198"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:56.808914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-2801227d-27d7-4cd8-a799-e9a9304ddf28 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for project f470bb55fd724a97959cc14ef30e0db0. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:09:56.813607 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-2801227d-27d7-4cd8-a799-e9a9304ddf28 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for user c3ba93c0e7ce4b0598807e3e3e2ec74a and project f470bb55fd724a97959cc14ef30e0db0. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:09:57.070157 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-2801227d-27d7-4cd8-a799-e9a9304ddf28 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for project f470bb55fd724a97959cc14ef30e0db0. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:09:57.074505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-2801227d-27d7-4cd8-a799-e9a9304ddf28 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for user c3ba93c0e7ce4b0598807e3e3e2ec74a and project f470bb55fd724a97959cc14ef30e0db0. Resources: {'key_pairs'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:09:57.088174 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2801227d-27d7-4cd8-a799-e9a9304ddf28 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.548530 Dec 03 15:09:57.088822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 449/925] 10.222.0.63 () {60 vars in 1148 bytes} [Thu Dec 3 15:09:56 2020] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:09:57.105171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-687db825-a869-4563-8b0d-e20fe55887f2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: .version_select at 0x7fd5f6a24c80>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-1253914480", "description": "tempest-TestVolumeBootPattern-1253914480 description"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:57.328960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-687db825-a869-4563-8b0d-e20fe55887f2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.232595 Dec 03 15:09:57.330073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 477/926] 10.222.0.63 () {60 vars in 1170 bytes} [Thu Dec 3 15:09:57 2020] POST /compute/v2.1/os-security-groups => generated 251 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:09:57.347369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ac2e67c5-7e04-4ca5-9432-9bf668b3f54e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: .version_select at 0x7fd5f69e4a60>, body: {"security_group_rule": {"parent_group_id": "d1b57de3-957d-4a2e-a4de-5c259d445835", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:57.570606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ac2e67c5-7e04-4ca5-9432-9bf668b3f54e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.232380 Dec 03 15:09:57.571406 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 450/927] 10.222.0.63 () {60 vars in 1185 bytes} [Thu Dec 3 15:09:57 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:09:57.590541 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f2c87097-4d38-4a0b-be53-26463e1f4e49 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: .version_select at 0x7fd5f572e620>, body: {"security_group_rule": {"parent_group_id": "d1b57de3-957d-4a2e-a4de-5c259d445835", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:09:57.807139 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7099f950-7ae1-4d69-8624-74ad28a6823b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:57.808076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7099f950-7ae1-4d69-8624-74ad28a6823b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:57.819276 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7099f950-7ae1-4d69-8624-74ad28a6823b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:57.820339 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7099f950-7ae1-4d69-8624-74ad28a6823b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:57.824422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7099f950-7ae1-4d69-8624-74ad28a6823b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:57.825207 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7099f950-7ae1-4d69-8624-74ad28a6823b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:57.938753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f2c87097-4d38-4a0b-be53-26463e1f4e49 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.359828 Dec 03 15:09:57.939644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 478/928] 10.222.0.63 () {60 vars in 1185 bytes} [Thu Dec 3 15:09:57 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:09:57.940193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7099f950-7ae1-4d69-8624-74ad28a6823b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:09:58.117549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7099f950-7ae1-4d69-8624-74ad28a6823b tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "DELETE /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 204 len: 0 microversion: 2.20 time: 0.324193 Dec 03 15:09:58.121629 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 451/929] 10.222.0.63 () {60 vars in 1270 bytes} [Thu Dec 3 15:09:57 2020] DELETE /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 03 15:09:58.138687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:58.139681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:58.154906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:58.155744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:58.157282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:58.158253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:58.467269 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:58.485111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:58.492514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:58.494683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6002451c-4803-4f5b-92e3-0f5ecdb4cf36 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.371273 Dec 03 15:09:58.495528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 479/930] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:58 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:09:59.521696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:09:59.522495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:09:59.530855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:59.531369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:59.532259 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:09:59.532922 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:09:59.779736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:59.796720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:59.803972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:09:59.805214 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9e621dbb-1b08-427a-943a-8cf991154078 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.293322 Dec 03 15:09:59.806126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 452/931] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:09:59 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:10:00.830325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:00.831006 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:00.839740 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:00.840497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:00.841557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:00.842274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:01.320894 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:01.339475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:01.347074 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:01.348552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-63e6c020-95d8-4c62-a259-2ffc46b3ae93 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1725 microversion: 2.20 time: 0.527948 Dec 03 15:10:01.354249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 480/932] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:10:00 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1725 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:10:01.866434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-64258ec6-9357-420c-996d-3b0736182fca req-90dd28f7-74a6-4bb5-82b7-399db55f2662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2dedaf2-51f5-458f-8e08-7814bc6780c3", "name": "network-vif-deleted", "tag": "0b68efc4-0565-4c23-9acc-fbbc726bba64"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:01.876906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:10:01.876906 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:10:01.889170 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-64258ec6-9357-420c-996d-3b0736182fca req-90dd28f7-74a6-4bb5-82b7-399db55f2662 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:01.890611 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-64258ec6-9357-420c-996d-3b0736182fca req-90dd28f7-74a6-4bb5-82b7-399db55f2662 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:01.916106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-64258ec6-9357-420c-996d-3b0736182fca req-90dd28f7-74a6-4bb5-82b7-399db55f2662 service nova] Creating event network-vif-deleted:0b68efc4-0565-4c23-9acc-fbbc726bba64 for instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 on hv-cinder-75790 Dec 03 15:10:01.930219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-64258ec6-9357-420c-996d-3b0736182fca req-90dd28f7-74a6-4bb5-82b7-399db55f2662 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076905 Dec 03 15:10:01.934031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 453/933] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:10:01 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:10:02.378720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:02.379639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:02.388941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:02.389454 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:02.390326 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:02.390822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:02.490024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:02.490685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:02.491196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lazy-loading 'fault' on Instance uuid e2dedaf2-51f5-458f-8e08-7814bc6780c3 {{(pid=94374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:10:02.621205 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:02.653243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:02.683409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02eb117eb6b349819521771a97d3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f608c43dc4544cf8abe2b82be12c9880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:02.685052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-79a6db46-319f-42f0-9d81-f0e973c6f9c0 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 200 len: 1371 microversion: 2.20 time: 0.316133 Dec 03 15:10:02.685870 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 481/934] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:10:02 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 15:10:03.720325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:03.721699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:03.731043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:03.731536 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:03.732595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:03.733091 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:03.801155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] HTTP exception thrown: Instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 could not be found. Dec 03 15:10:03.802114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Returning 404 to user: Instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:10:03.803277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d9cdf17e-61fd-4ea8-94f2-8aa2ddcbde8f tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 404 len: 111 microversion: 2.20 time: 0.101494 Dec 03 15:10:03.804055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 454/935] 10.222.0.63 () {60 vars in 1267 bytes} [Thu Dec 3 15:10:03 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 03 15:10:03.819299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4921c3aa-3115-4916-8c97-572b388ce95d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '.version_select at 0x7fd5f56df730>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:03.853089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4921c3aa-3115-4916-8c97-572b388ce95d tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323975429" status: 204 len: 0 microversion: 2.20 time: 0.043029 Dec 03 15:10:03.853972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 482/936] 10.222.0.63 () {60 vars in 1252 bytes} [Thu Dec 3 15:10:03 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323975429 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 03 15:10:07.336359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:07.337017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:07.345410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:07.345937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:07.346807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:07.347308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:07.401361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] HTTP exception thrown: Instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 could not be found. Dec 03 15:10:07.402058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Returning 404 to user: Instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:10:07.402959 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ed25a9d8-617e-4157-a466-e18b391a861c tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "DELETE /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 404 len: 111 microversion: 2.1 time: 0.075723 Dec 03 15:10:07.403745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 455/937] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:10:07 2020] DELETE /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:10:07.418227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:07.418896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: e2dedaf2-51f5-458f-8e08-7814bc6780c3] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:07.427542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:07.428048 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:07.428882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:07.429372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:07.487918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] HTTP exception thrown: Instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 could not be found. Dec 03 15:10:07.488574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Returning 404 to user: Instance e2dedaf2-51f5-458f-8e08-7814bc6780c3 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:10:07.489478 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9c4182a2-1bae-4384-adcf-018663223c68 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3" status: 404 len: 111 microversion: 2.1 time: 0.081383 Dec 03 15:10:07.490129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 483/938] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:07 2020] GET /compute/v2.1/servers/e2dedaf2-51f5-458f-8e08-7814bc6780c3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:10:08.760605 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:08.761145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:08.768949 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:08.769463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:08.770350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:08.770845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:08.828670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] HTTP exception thrown: Instance f53f7d53-2ae6-4edd-84c2-09e523498d7d could not be found. Dec 03 15:10:08.829333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Returning 404 to user: Instance f53f7d53-2ae6-4edd-84c2-09e523498d7d could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:10:08.830256 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7013c947-2a7a-4ab2-b070-4b966c29a1f5 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "DELETE /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 404 len: 111 microversion: 2.1 time: 0.078807 Dec 03 15:10:08.830871 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 456/939] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:10:08 2020] DELETE /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:10:08.845318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:08.846023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] [instance: f53f7d53-2ae6-4edd-84c2-09e523498d7d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:08.855223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:08.855724 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:08.856637 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:08.857167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:08.912150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] HTTP exception thrown: Instance f53f7d53-2ae6-4edd-84c2-09e523498d7d could not be found. Dec 03 15:10:08.912804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] Returning 404 to user: Instance f53f7d53-2ae6-4edd-84c2-09e523498d7d could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:10:08.913701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1304c637-fbc6-48e6-8330-3f206438f531 tempest-AttachVolumeShelveTestJSON-1467326767 tempest-AttachVolumeShelveTestJSON-1467326767] 10.222.0.63 "GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d" status: 404 len: 111 microversion: 2.1 time: 0.078309 Dec 03 15:10:08.914356 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 484/940] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:08 2020] GET /compute/v2.1/servers/f53f7d53-2ae6-4edd-84c2-09e523498d7d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:10:22.319484 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1696251925", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415978198", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1253914480"}], "block_device_mapping_v2": [{"uuid": "b499728d-a714-4a55-b77e-eaba9d4884c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca7902d6-3500-4f57-934f-b73bb22a6c84"}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:22.504461 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] validate_networks() for [('ca7902d6-3500-4f57-934f-b73bb22a6c84', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:10:23.099584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:10:23.100134 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:10:23.100786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:10:23.101244 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:10:23.101700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:10:23.111171 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:23.111674 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:23.112748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:23.113238 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:23.132986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for project f470bb55fd724a97959cc14ef30e0db0. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:10:23.138024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for user c3ba93c0e7ce4b0598807e3e3e2ec74a and project f470bb55fd724a97959cc14ef30e0db0. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:10:23.245739 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:10:23.248196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b499728d-a714-4a55-b77e-eaba9d4884c3',volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:10:23.437687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3553298f-3635-43eb-9247-01876a2704d2 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.127603 Dec 03 15:10:23.438410 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 457/941] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:10:22 2020] POST /compute/v2.1/servers => generated 413 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:10:23.454794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a419b368-aaff-4191-8460-05cfd03fb453 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:23.455463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a419b368-aaff-4191-8460-05cfd03fb453 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:23.544007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a419b368-aaff-4191-8460-05cfd03fb453 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:23.552409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a419b368-aaff-4191-8460-05cfd03fb453 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1094 microversion: 2.1 time: 0.107449 Dec 03 15:10:23.563275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 485/942] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:23 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1094 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:24.577302 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5e77f555-719d-4194-8ed2-e7746a6b6da8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:24.577993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5e77f555-719d-4194-8ed2-e7746a6b6da8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:24.587468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e77f555-719d-4194-8ed2-e7746a6b6da8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:24.587971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e77f555-719d-4194-8ed2-e7746a6b6da8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:24.588854 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e77f555-719d-4194-8ed2-e7746a6b6da8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:24.589343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5e77f555-719d-4194-8ed2-e7746a6b6da8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:24.742710 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5e77f555-719d-4194-8ed2-e7746a6b6da8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:24.751825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5e77f555-719d-4194-8ed2-e7746a6b6da8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1144 microversion: 2.1 time: 0.184456 Dec 03 15:10:24.752668 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 458/943] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:24 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1144 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:25.774045 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4bbe8f0f-9066-48c4-811c-4a024d11cab8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:25.774765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4bbe8f0f-9066-48c4-811c-4a024d11cab8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:25.783520 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4bbe8f0f-9066-48c4-811c-4a024d11cab8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:25.784028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4bbe8f0f-9066-48c4-811c-4a024d11cab8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:25.784880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4bbe8f0f-9066-48c4-811c-4a024d11cab8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:25.785382 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4bbe8f0f-9066-48c4-811c-4a024d11cab8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:25.922552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4bbe8f0f-9066-48c4-811c-4a024d11cab8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:25.932204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4bbe8f0f-9066-48c4-811c-4a024d11cab8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1136 microversion: 2.1 time: 0.167039 Dec 03 15:10:25.932771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 486/944] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:25 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1136 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:26.955941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c8495fde-9bd5-49ba-931c-604817360e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:26.956598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c8495fde-9bd5-49ba-931c-604817360e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:26.965521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c8495fde-9bd5-49ba-931c-604817360e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:26.966102 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c8495fde-9bd5-49ba-931c-604817360e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:26.967404 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c8495fde-9bd5-49ba-931c-604817360e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:26.967404 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c8495fde-9bd5-49ba-931c-604817360e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:27.111511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c8495fde-9bd5-49ba-931c-604817360e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:27.120983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c8495fde-9bd5-49ba-931c-604817360e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1210 microversion: 2.1 time: 0.174807 Dec 03 15:10:27.121578 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 459/945] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:26 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1210 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:28.144046 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d22e03a0-e29d-48e3-b325-a3c419e5f88e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:28.144609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d22e03a0-e29d-48e3-b325-a3c419e5f88e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:28.153886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d22e03a0-e29d-48e3-b325-a3c419e5f88e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:28.154430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d22e03a0-e29d-48e3-b325-a3c419e5f88e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:28.155295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d22e03a0-e29d-48e3-b325-a3c419e5f88e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:28.155790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d22e03a0-e29d-48e3-b325-a3c419e5f88e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:28.685342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d22e03a0-e29d-48e3-b325-a3c419e5f88e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:28.707093 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d22e03a0-e29d-48e3-b325-a3c419e5f88e tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.572161 Dec 03 15:10:28.720665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 487/946] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:28 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:29.224670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-bec21734-6eb7-4a3b-af03-99684552ada0 req-ebebcf0b-c342-472f-8f6e-833c5b4401c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0423581-5320-4d03-8e5c-2fc88bf1837b", "tag": "1d444986-6670-4748-b35e-a5b3b20c3660"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:29.231977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:10:29.231977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:10:29.243804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-bec21734-6eb7-4a3b-af03-99684552ada0 req-ebebcf0b-c342-472f-8f6e-833c5b4401c8 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:29.244527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-bec21734-6eb7-4a3b-af03-99684552ada0 req-ebebcf0b-c342-472f-8f6e-833c5b4401c8 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:29.267189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-bec21734-6eb7-4a3b-af03-99684552ada0 req-ebebcf0b-c342-472f-8f6e-833c5b4401c8 service nova] Creating event network-changed:1d444986-6670-4748-b35e-a5b3b20c3660 for instance f0423581-5320-4d03-8e5c-2fc88bf1837b on hv-cinder-75790 Dec 03 15:10:29.272483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-bec21734-6eb7-4a3b-af03-99684552ada0 req-ebebcf0b-c342-472f-8f6e-833c5b4401c8 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056771 Dec 03 15:10:29.273137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 460/947] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:10:29 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:10:29.732538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2f2e858d-64ab-4af9-b98a-676ff0aca76d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:29.733213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2f2e858d-64ab-4af9-b98a-676ff0aca76d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:29.741706 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f2e858d-64ab-4af9-b98a-676ff0aca76d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:29.742251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f2e858d-64ab-4af9-b98a-676ff0aca76d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:29.743402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f2e858d-64ab-4af9-b98a-676ff0aca76d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:29.743721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2f2e858d-64ab-4af9-b98a-676ff0aca76d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:30.193772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2f2e858d-64ab-4af9-b98a-676ff0aca76d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:30.211393 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2f2e858d-64ab-4af9-b98a-676ff0aca76d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.488475 Dec 03 15:10:30.212903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 488/948] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:29 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:31.236164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-db4bae66-6765-40be-879a-4bd810348bc4 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:31.236867 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-db4bae66-6765-40be-879a-4bd810348bc4 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:31.245912 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db4bae66-6765-40be-879a-4bd810348bc4 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:31.246444 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db4bae66-6765-40be-879a-4bd810348bc4 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:31.247285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db4bae66-6765-40be-879a-4bd810348bc4 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:31.247777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-db4bae66-6765-40be-879a-4bd810348bc4 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:31.473924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-db4bae66-6765-40be-879a-4bd810348bc4 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:31.483290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-db4bae66-6765-40be-879a-4bd810348bc4 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.257509 Dec 03 15:10:31.483890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 461/949] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:31 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:32.506427 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f8d08907-fdc6-45f8-b857-7cb369f95cfb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:32.507111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f8d08907-fdc6-45f8-b857-7cb369f95cfb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:32.515817 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8d08907-fdc6-45f8-b857-7cb369f95cfb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:32.516334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8d08907-fdc6-45f8-b857-7cb369f95cfb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:32.517185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8d08907-fdc6-45f8-b857-7cb369f95cfb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:32.517686 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f8d08907-fdc6-45f8-b857-7cb369f95cfb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:32.769681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f8d08907-fdc6-45f8-b857-7cb369f95cfb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:32.778886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f8d08907-fdc6-45f8-b857-7cb369f95cfb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.281584 Dec 03 15:10:32.779495 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 489/950] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:32 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:33.802424 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-273e15a2-2538-4ec7-b36b-b3bce8c901d9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:33.803105 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-273e15a2-2538-4ec7-b36b-b3bce8c901d9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:33.811321 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-273e15a2-2538-4ec7-b36b-b3bce8c901d9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:33.811822 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-273e15a2-2538-4ec7-b36b-b3bce8c901d9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:33.812655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-273e15a2-2538-4ec7-b36b-b3bce8c901d9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:33.813140 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-273e15a2-2538-4ec7-b36b-b3bce8c901d9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:34.028355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-273e15a2-2538-4ec7-b36b-b3bce8c901d9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:34.037211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-273e15a2-2538-4ec7-b36b-b3bce8c901d9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.244003 Dec 03 15:10:34.037807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 462/951] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:33 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:35.061897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e8a2b703-1465-4717-b26a-e841eb73ae3b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:35.062608 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e8a2b703-1465-4717-b26a-e841eb73ae3b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:35.073422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8a2b703-1465-4717-b26a-e841eb73ae3b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:35.073946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8a2b703-1465-4717-b26a-e841eb73ae3b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:35.074824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8a2b703-1465-4717-b26a-e841eb73ae3b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:35.075318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e8a2b703-1465-4717-b26a-e841eb73ae3b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:35.300360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e8a2b703-1465-4717-b26a-e841eb73ae3b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:35.310350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e8a2b703-1465-4717-b26a-e841eb73ae3b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.258108 Dec 03 15:10:35.310900 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 490/952] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:35 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:36.333695 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-16c7e086-1570-48b1-9ff5-769432fd73e6 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:36.334412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-16c7e086-1570-48b1-9ff5-769432fd73e6 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:36.344391 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-16c7e086-1570-48b1-9ff5-769432fd73e6 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:36.344895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-16c7e086-1570-48b1-9ff5-769432fd73e6 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:36.345816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-16c7e086-1570-48b1-9ff5-769432fd73e6 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:36.346443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-16c7e086-1570-48b1-9ff5-769432fd73e6 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:36.590830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-16c7e086-1570-48b1-9ff5-769432fd73e6 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:36.600993 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-16c7e086-1570-48b1-9ff5-769432fd73e6 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.276812 Dec 03 15:10:36.601606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 463/953] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:36 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:37.625187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-06cfab5a-6a3d-47de-bffa-922ce70b3897 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:37.625855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-06cfab5a-6a3d-47de-bffa-922ce70b3897 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:37.634681 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-06cfab5a-6a3d-47de-bffa-922ce70b3897 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:37.635191 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-06cfab5a-6a3d-47de-bffa-922ce70b3897 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:37.636038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-06cfab5a-6a3d-47de-bffa-922ce70b3897 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:37.636538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-06cfab5a-6a3d-47de-bffa-922ce70b3897 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:37.880251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-06cfab5a-6a3d-47de-bffa-922ce70b3897 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:37.889285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-06cfab5a-6a3d-47de-bffa-922ce70b3897 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.273675 Dec 03 15:10:37.889848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 491/954] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:37 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:38.747528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-f62b177b-e913-4123-933f-6e5283841a61 req-25223621-fb72-438a-ae95-db084805f648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0423581-5320-4d03-8e5c-2fc88bf1837b", "name": "network-vif-plugged", "status": "completed", "tag": "1d444986-6670-4748-b35e-a5b3b20c3660"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:38.754353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:10:38.754353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:10:38.765295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f62b177b-e913-4123-933f-6e5283841a61 req-25223621-fb72-438a-ae95-db084805f648 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:38.765980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f62b177b-e913-4123-933f-6e5283841a61 req-25223621-fb72-438a-ae95-db084805f648 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:38.787431 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-f62b177b-e913-4123-933f-6e5283841a61 req-25223621-fb72-438a-ae95-db084805f648 service nova] Creating event network-vif-plugged:1d444986-6670-4748-b35e-a5b3b20c3660 for instance f0423581-5320-4d03-8e5c-2fc88bf1837b on hv-cinder-75790 Dec 03 15:10:38.792708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-f62b177b-e913-4123-933f-6e5283841a61 req-25223621-fb72-438a-ae95-db084805f648 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054932 Dec 03 15:10:38.793692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 464/955] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:10:38 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:10:38.912568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e06a5a7a-e3ce-4476-ac17-4925dc4c29bc tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:38.913434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e06a5a7a-e3ce-4476-ac17-4925dc4c29bc tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:38.921682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e06a5a7a-e3ce-4476-ac17-4925dc4c29bc tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:38.922332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e06a5a7a-e3ce-4476-ac17-4925dc4c29bc tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:38.923268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e06a5a7a-e3ce-4476-ac17-4925dc4c29bc tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:38.923848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e06a5a7a-e3ce-4476-ac17-4925dc4c29bc tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:39.248860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e06a5a7a-e3ce-4476-ac17-4925dc4c29bc tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:39.257669 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e06a5a7a-e3ce-4476-ac17-4925dc4c29bc tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.354647 Dec 03 15:10:39.258904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 492/956] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:38 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:39.768351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-493824797", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:39.840218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] validate_networks() for None {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:10:40.113624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:10:40.114150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:10:40.114780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:10:40.115289 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:10:40.115759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:10:40.125016 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:40.125527 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:40.126475 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:40.126969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:40.147647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Getting quotas for project 860dd996f4a04eaaabea9a8cf042f3c6. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:10:40.153459 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Getting quotas for user 3329d958156244d3a7eb7ff342600720 and project 860dd996f4a04eaaabea9a8cf042f3c6. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:10:40.167286 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:10:40.170040 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:10:40.240801 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-addf6130-c483-4cc7-aeff-0997ce782e58 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482715 Dec 03 15:10:40.241714 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 465/957] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:10:39 2020] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:10:40.258689 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-344f8fc0-65dd-41a5-8da6-9c639f9d9052 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:40.260214 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-344f8fc0-65dd-41a5-8da6-9c639f9d9052 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:40.287612 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3ecd289b-b9d4-4a7d-9fc2-a7584383c60a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:40.288426 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3ecd289b-b9d4-4a7d-9fc2-a7584383c60a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:40.304232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3ecd289b-b9d4-4a7d-9fc2-a7584383c60a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:40.305211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3ecd289b-b9d4-4a7d-9fc2-a7584383c60a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:40.306264 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3ecd289b-b9d4-4a7d-9fc2-a7584383c60a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:40.306769 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3ecd289b-b9d4-4a7d-9fc2-a7584383c60a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:40.437551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-344f8fc0-65dd-41a5-8da6-9c639f9d9052 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:40.452590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-344f8fc0-65dd-41a5-8da6-9c639f9d9052 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1214 microversion: 2.1 time: 0.203223 Dec 03 15:10:40.453651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 493/958] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:40 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:40.571627 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3ecd289b-b9d4-4a7d-9fc2-a7584383c60a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:40.580963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3ecd289b-b9d4-4a7d-9fc2-a7584383c60a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1273 microversion: 2.1 time: 0.309154 Dec 03 15:10:40.581565 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 466/959] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:40 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1273 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:41.480290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-330f74bc-07ec-4c4c-b0e5-ab1ef852211c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:41.480952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-330f74bc-07ec-4c4c-b0e5-ab1ef852211c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:41.489185 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-330f74bc-07ec-4c4c-b0e5-ab1ef852211c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:41.489692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-330f74bc-07ec-4c4c-b0e5-ab1ef852211c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:41.490576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-330f74bc-07ec-4c4c-b0e5-ab1ef852211c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:41.491081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-330f74bc-07ec-4c4c-b0e5-ab1ef852211c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:41.618197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b13a5f97-4c59-4e18-8f0a-19890eb44786 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:41.619587 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b13a5f97-4c59-4e18-8f0a-19890eb44786 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:41.627636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13a5f97-4c59-4e18-8f0a-19890eb44786 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:41.628161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13a5f97-4c59-4e18-8f0a-19890eb44786 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:41.629218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13a5f97-4c59-4e18-8f0a-19890eb44786 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:41.629721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b13a5f97-4c59-4e18-8f0a-19890eb44786 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:41.645628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-330f74bc-07ec-4c4c-b0e5-ab1ef852211c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:41.655111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-330f74bc-07ec-4c4c-b0e5-ab1ef852211c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1266 microversion: 2.1 time: 0.184508 Dec 03 15:10:41.655945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 494/960] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:41 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:41.879945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b13a5f97-4c59-4e18-8f0a-19890eb44786 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:41.889364 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b13a5f97-4c59-4e18-8f0a-19890eb44786 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1460 microversion: 2.1 time: 0.294013 Dec 03 15:10:41.890310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 467/961] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:41 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1460 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:41.912840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-615abee2-57fc-4067-8144-7e9ec152924a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:41.913516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-615abee2-57fc-4067-8144-7e9ec152924a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:41.922923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-615abee2-57fc-4067-8144-7e9ec152924a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:41.923438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-615abee2-57fc-4067-8144-7e9ec152924a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:41.924385 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-615abee2-57fc-4067-8144-7e9ec152924a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:41.924889 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-615abee2-57fc-4067-8144-7e9ec152924a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:42.288255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-615abee2-57fc-4067-8144-7e9ec152924a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:42.297760 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-615abee2-57fc-4067-8144-7e9ec152924a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1460 microversion: 2.1 time: 0.394148 Dec 03 15:10:42.298399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 495/962] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:41 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1460 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:42.321334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9bce59ba-b3a8-4ec0-83b9-58ae0197314c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: .version_select at 0x7fd5f5eb6f28>, body: {"pool": null} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:42.679230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d985edca-488b-4cad-89aa-01f2483586a7 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:42.679956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d985edca-488b-4cad-89aa-01f2483586a7 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:42.693349 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d985edca-488b-4cad-89aa-01f2483586a7 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:42.694167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d985edca-488b-4cad-89aa-01f2483586a7 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:42.695255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d985edca-488b-4cad-89aa-01f2483586a7 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:42.696805 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d985edca-488b-4cad-89aa-01f2483586a7 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:42.885514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d985edca-488b-4cad-89aa-01f2483586a7 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:42.901199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d985edca-488b-4cad-89aa-01f2483586a7 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1272 microversion: 2.1 time: 0.231151 Dec 03 15:10:42.902133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 496/963] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:42 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:10:43.925574 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a1c36f7f-195b-4d1a-933e-30f6fc2753e6 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:43.926282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a1c36f7f-195b-4d1a-933e-30f6fc2753e6 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:43.934716 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1c36f7f-195b-4d1a-933e-30f6fc2753e6 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:43.935227 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1c36f7f-195b-4d1a-933e-30f6fc2753e6 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:43.936079 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1c36f7f-195b-4d1a-933e-30f6fc2753e6 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:43.936577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a1c36f7f-195b-4d1a-933e-30f6fc2753e6 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:44.198880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a1c36f7f-195b-4d1a-933e-30f6fc2753e6 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:44.207591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a1c36f7f-195b-4d1a-933e-30f6fc2753e6 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.291367 Dec 03 15:10:44.208498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 497/964] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:43 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:10:44.665881 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9bce59ba-b3a8-4ec0-83b9-58ae0197314c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.353893 Dec 03 15:10:44.666576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 468/965] 10.222.0.63 () {60 vars in 1160 bytes} [Thu Dec 3 15:10:42 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:10:44.684570 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.2.136"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:44.685842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:44.693747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:44.694281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:44.695114 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:44.695794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:44.766924 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Acquired lock "refresh_cache-f0423581-5320-4d03-8e5c-2fc88bf1837b" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:10:45.231996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-809f5e5f-3ccf-40fd-81ff-81e1ece57b1f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:45.232546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-809f5e5f-3ccf-40fd-81ff-81e1ece57b1f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:45.240846 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-809f5e5f-3ccf-40fd-81ff-81e1ece57b1f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:45.241351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-809f5e5f-3ccf-40fd-81ff-81e1ece57b1f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:45.242827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-809f5e5f-3ccf-40fd-81ff-81e1ece57b1f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:45.243400 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-809f5e5f-3ccf-40fd-81ff-81e1ece57b1f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:45.476003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-809f5e5f-3ccf-40fd-81ff-81e1ece57b1f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:45.486083 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-809f5e5f-3ccf-40fd-81ff-81e1ece57b1f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.263457 Dec 03 15:10:45.486733 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 469/966] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:45 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:46.511181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7f3732e0-5426-4af6-9deb-50219337059b tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:46.511856 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7f3732e0-5426-4af6-9deb-50219337059b tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:46.519788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f3732e0-5426-4af6-9deb-50219337059b tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:46.520295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f3732e0-5426-4af6-9deb-50219337059b tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:46.521149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f3732e0-5426-4af6-9deb-50219337059b tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:46.521646 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f3732e0-5426-4af6-9deb-50219337059b tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:46.750070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7f3732e0-5426-4af6-9deb-50219337059b tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:46.759751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7f3732e0-5426-4af6-9deb-50219337059b tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.258575 Dec 03 15:10:46.760374 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 470/967] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:46 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:10:47.179249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Building network info cache for instance {{(pid=94374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:10:47.192844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-5d0e79db-98b0-4e33-8b95-5fa92d058a4e req-4e11911b-aa99-45fe-9aee-b46d1658c932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0423581-5320-4d03-8e5c-2fc88bf1837b", "tag": "1d444986-6670-4748-b35e-a5b3b20c3660"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:47.201236 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:10:47.201236 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:10:47.210534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-5d0e79db-98b0-4e33-8b95-5fa92d058a4e req-4e11911b-aa99-45fe-9aee-b46d1658c932 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:47.211750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-5d0e79db-98b0-4e33-8b95-5fa92d058a4e req-4e11911b-aa99-45fe-9aee-b46d1658c932 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:47.230897 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-5d0e79db-98b0-4e33-8b95-5fa92d058a4e req-4e11911b-aa99-45fe-9aee-b46d1658c932 service nova] Creating event network-changed:1d444986-6670-4748-b35e-a5b3b20c3660 for instance f0423581-5320-4d03-8e5c-2fc88bf1837b on hv-cinder-75790 Dec 03 15:10:47.236165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-5d0e79db-98b0-4e33-8b95-5fa92d058a4e req-4e11911b-aa99-45fe-9aee-b46d1658c932 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052654 Dec 03 15:10:47.236807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 471/968] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:10:47 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:10:47.782977 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-02bf06ec-ab94-468a-b5e0-41717fee05d9 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:47.783765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-02bf06ec-ab94-468a-b5e0-41717fee05d9 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:47.805476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02bf06ec-ab94-468a-b5e0-41717fee05d9 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:47.806026 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02bf06ec-ab94-468a-b5e0-41717fee05d9 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:47.818220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02bf06ec-ab94-468a-b5e0-41717fee05d9 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:47.818909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02bf06ec-ab94-468a-b5e0-41717fee05d9 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:48.078180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-02bf06ec-ab94-468a-b5e0-41717fee05d9 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:48.087982 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-02bf06ec-ab94-468a-b5e0-41717fee05d9 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.314908 Dec 03 15:10:48.088861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 472/969] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:47 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:10:48.913425 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Updating instance_info_cache with network_info: [{"id": "1d444986-6670-4748-b35e-a5b3b20c3660", "address": "fa:16:3e:c2:ea:05", "network": {"id": "ca7902d6-3500-4f57-934f-b73bb22a6c84", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-395720009-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f470bb55fd724a97959cc14ef30e0db0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap1d444986-66", "ovs_interfaceid": "1d444986-6670-4748-b35e-a5b3b20c3660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:10:48.925433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Releasing lock "refresh_cache-f0423581-5320-4d03-8e5c-2fc88bf1837b" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:10:48.926396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fe527dc4-2167-4524-9fbb-9254f08d802b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b/action" status: 202 len: 0 microversion: 2.1 time: 4.251974 Dec 03 15:10:48.927067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 498/970] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:10:44 2020] POST /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b/action => generated 0 bytes in 4253 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 15:10:49.114290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7972c410-ccb2-4ed5-96f0-5ad0b66f90c5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:49.115020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7972c410-ccb2-4ed5-96f0-5ad0b66f90c5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:49.123384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7972c410-ccb2-4ed5-96f0-5ad0b66f90c5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:49.123903 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7972c410-ccb2-4ed5-96f0-5ad0b66f90c5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:49.124764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7972c410-ccb2-4ed5-96f0-5ad0b66f90c5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:49.125262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7972c410-ccb2-4ed5-96f0-5ad0b66f90c5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:49.277862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-88413adc-755e-491e-a925-14fcbad1a46a req-2cf4b096-1b1e-49f0-bb86-f0419bef20f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fd5c24-95bc-4fe1-b71e-605a2c980760", "tag": "3cc21dfe-f48a-4216-8892-7dae739356f2"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:49.285126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:10:49.285126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:10:49.294895 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-88413adc-755e-491e-a925-14fcbad1a46a req-2cf4b096-1b1e-49f0-bb86-f0419bef20f5 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:49.295402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-88413adc-755e-491e-a925-14fcbad1a46a req-2cf4b096-1b1e-49f0-bb86-f0419bef20f5 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:49.314946 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-88413adc-755e-491e-a925-14fcbad1a46a req-2cf4b096-1b1e-49f0-bb86-f0419bef20f5 service nova] Creating event network-changed:3cc21dfe-f48a-4216-8892-7dae739356f2 for instance 40fd5c24-95bc-4fe1-b71e-605a2c980760 on hv-cinder-75790 Dec 03 15:10:49.320206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-88413adc-755e-491e-a925-14fcbad1a46a req-2cf4b096-1b1e-49f0-bb86-f0419bef20f5 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051579 Dec 03 15:10:49.320857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 499/971] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:10:49 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:10:49.497702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7972c410-ccb2-4ed5-96f0-5ad0b66f90c5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:49.507261 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7972c410-ccb2-4ed5-96f0-5ad0b66f90c5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.403762 Dec 03 15:10:49.508436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 473/972] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:49 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:50.533315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-097b8ef6-2cd4-4b24-9a7b-2539cc0c4fd2 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:50.534150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-097b8ef6-2cd4-4b24-9a7b-2539cc0c4fd2 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:50.543490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-097b8ef6-2cd4-4b24-9a7b-2539cc0c4fd2 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:50.544010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-097b8ef6-2cd4-4b24-9a7b-2539cc0c4fd2 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:50.544914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-097b8ef6-2cd4-4b24-9a7b-2539cc0c4fd2 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:50.545416 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-097b8ef6-2cd4-4b24-9a7b-2539cc0c4fd2 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:51.138551 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-097b8ef6-2cd4-4b24-9a7b-2539cc0c4fd2 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:51.147672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-097b8ef6-2cd4-4b24-9a7b-2539cc0c4fd2 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.625417 Dec 03 15:10:51.148319 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 500/973] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:50 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:52.170439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7f9388a4-e84e-4ff9-8a95-9e391ea7a3b5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:52.171108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7f9388a4-e84e-4ff9-8a95-9e391ea7a3b5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:52.179092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f9388a4-e84e-4ff9-8a95-9e391ea7a3b5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:52.180649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f9388a4-e84e-4ff9-8a95-9e391ea7a3b5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:52.181247 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f9388a4-e84e-4ff9-8a95-9e391ea7a3b5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:52.181744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7f9388a4-e84e-4ff9-8a95-9e391ea7a3b5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:52.406502 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7f9388a4-e84e-4ff9-8a95-9e391ea7a3b5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:52.415609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7f9388a4-e84e-4ff9-8a95-9e391ea7a3b5 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.254845 Dec 03 15:10:52.416147 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 474/974] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:52 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:53.439395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b5616a46-5ac2-43b4-bef5-f582abb6fd3f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:53.440252 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b5616a46-5ac2-43b4-bef5-f582abb6fd3f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:53.448197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5616a46-5ac2-43b4-bef5-f582abb6fd3f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:53.448718 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5616a46-5ac2-43b4-bef5-f582abb6fd3f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:53.449568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5616a46-5ac2-43b4-bef5-f582abb6fd3f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:53.450236 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b5616a46-5ac2-43b4-bef5-f582abb6fd3f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:53.703220 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b5616a46-5ac2-43b4-bef5-f582abb6fd3f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:53.714057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b5616a46-5ac2-43b4-bef5-f582abb6fd3f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.284586 Dec 03 15:10:53.714965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 501/975] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:53 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:54.542063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-f2c11289-e25c-4ea3-8752-41617fec27b2 req-5ad9e512-73e8-44b4-8199-9fe3819df465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fd5c24-95bc-4fe1-b71e-605a2c980760", "name": "network-vif-plugged", "status": "completed", "tag": "3cc21dfe-f48a-4216-8892-7dae739356f2"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:54.548685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:10:54.548685 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:10:54.558925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f2c11289-e25c-4ea3-8752-41617fec27b2 req-5ad9e512-73e8-44b4-8199-9fe3819df465 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:54.559351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f2c11289-e25c-4ea3-8752-41617fec27b2 req-5ad9e512-73e8-44b4-8199-9fe3819df465 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:54.578258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-f2c11289-e25c-4ea3-8752-41617fec27b2 req-5ad9e512-73e8-44b4-8199-9fe3819df465 service nova] Creating event network-vif-plugged:3cc21dfe-f48a-4216-8892-7dae739356f2 for instance 40fd5c24-95bc-4fe1-b71e-605a2c980760 on hv-cinder-75790 Dec 03 15:10:54.583259 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-f2c11289-e25c-4ea3-8752-41617fec27b2 req-5ad9e512-73e8-44b4-8199-9fe3819df465 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050725 Dec 03 15:10:54.583907 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 475/976] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:10:54 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:10:54.738863 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a13d4979-108f-4343-988f-eac3ca54b757 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:54.739673 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a13d4979-108f-4343-988f-eac3ca54b757 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:54.748386 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a13d4979-108f-4343-988f-eac3ca54b757 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:54.749120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a13d4979-108f-4343-988f-eac3ca54b757 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:54.750462 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a13d4979-108f-4343-988f-eac3ca54b757 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:54.751108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a13d4979-108f-4343-988f-eac3ca54b757 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:55.049969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a13d4979-108f-4343-988f-eac3ca54b757 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:55.059496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a13d4979-108f-4343-988f-eac3ca54b757 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.329998 Dec 03 15:10:55.060101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 502/977] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:54 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:56.084767 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-304d6cb3-c3c9-4ca3-b391-e228b51291f3 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:56.085549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-304d6cb3-c3c9-4ca3-b391-e228b51291f3 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:56.094115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-304d6cb3-c3c9-4ca3-b391-e228b51291f3 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:56.094632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-304d6cb3-c3c9-4ca3-b391-e228b51291f3 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:56.095505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-304d6cb3-c3c9-4ca3-b391-e228b51291f3 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:56.095996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-304d6cb3-c3c9-4ca3-b391-e228b51291f3 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:56.325422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-304d6cb3-c3c9-4ca3-b391-e228b51291f3 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:56.334584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-304d6cb3-c3c9-4ca3-b391-e228b51291f3 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1314 microversion: 2.1 time: 0.260718 Dec 03 15:10:56.335251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 476/978] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:56 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:56.853677 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '.version_select at 0x7fd5fab7f7b8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:57.359175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-872a06cc-387f-4299-a112-97aeab3fa886 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:57.359847 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-872a06cc-387f-4299-a112-97aeab3fa886 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:57.367950 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-872a06cc-387f-4299-a112-97aeab3fa886 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:57.368503 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-872a06cc-387f-4299-a112-97aeab3fa886 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:57.369452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-872a06cc-387f-4299-a112-97aeab3fa886 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:57.370069 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-872a06cc-387f-4299-a112-97aeab3fa886 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:57.373117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:57.382363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:57.382880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:57.383736 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:57.384230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:57.448206 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Acquired lock "refresh_cache-add146c2-e4cc-491e-b5f9-17673e4a0c89" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:10:57.604193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-872a06cc-387f-4299-a112-97aeab3fa886 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:57.613488 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-872a06cc-387f-4299-a112-97aeab3fa886 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1464 microversion: 2.1 time: 0.264270 Dec 03 15:10:57.614137 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 477/979] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:57 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:10:57.697729 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d79bd1d2-dc93-42ee-8eaf-11fbdd557e05 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:57.698361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d79bd1d2-dc93-42ee-8eaf-11fbdd557e05 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:57.707017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d79bd1d2-dc93-42ee-8eaf-11fbdd557e05 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:57.707523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d79bd1d2-dc93-42ee-8eaf-11fbdd557e05 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:57.708369 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d79bd1d2-dc93-42ee-8eaf-11fbdd557e05 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:57.708860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d79bd1d2-dc93-42ee-8eaf-11fbdd557e05 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:57.780421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d79bd1d2-dc93-42ee-8eaf-11fbdd557e05 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:10:57.900778 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d79bd1d2-dc93-42ee-8eaf-11fbdd557e05 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "DELETE /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 204 len: 0 microversion: 2.1 time: 0.211958 Dec 03 15:10:57.901703 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 478/980] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:10:57 2020] DELETE /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:10:57.916006 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f430a40c-2b1d-4d8d-a42e-fa68037fe162 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:57.916781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f430a40c-2b1d-4d8d-a42e-fa68037fe162 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:57.925163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f430a40c-2b1d-4d8d-a42e-fa68037fe162 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:57.925672 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f430a40c-2b1d-4d8d-a42e-fa68037fe162 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:57.926577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f430a40c-2b1d-4d8d-a42e-fa68037fe162 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:57.927072 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f430a40c-2b1d-4d8d-a42e-fa68037fe162 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:58.164848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f430a40c-2b1d-4d8d-a42e-fa68037fe162 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:58.182688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f430a40c-2b1d-4d8d-a42e-fa68037fe162 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1470 microversion: 2.1 time: 0.275764 Dec 03 15:10:58.183760 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 479/981] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:57 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1470 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:10:59.218665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5439fbdb-5c9b-4c78-b98d-690dcab2b89c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:10:59.219655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5439fbdb-5c9b-4c78-b98d-690dcab2b89c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:10:59.227880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5439fbdb-5c9b-4c78-b98d-690dcab2b89c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:59.228390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5439fbdb-5c9b-4c78-b98d-690dcab2b89c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:59.229254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5439fbdb-5c9b-4c78-b98d-690dcab2b89c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:59.229752 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5439fbdb-5c9b-4c78-b98d-690dcab2b89c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:59.426267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Building network info cache for instance {{(pid=94374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:10:59.459138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5439fbdb-5c9b-4c78-b98d-690dcab2b89c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:10:59.469107 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5439fbdb-5c9b-4c78-b98d-690dcab2b89c tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1470 microversion: 2.1 time: 0.259794 Dec 03 15:10:59.469824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 480/982] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:10:59 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 15:10:59.479563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-a1bd27b6-3e00-486f-abb5-31a875ce2207 req-9e979a71-f1cb-4443-a38b-63b4b59d1e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add146c2-e4cc-491e-b5f9-17673e4a0c89", "tag": "f82f881d-f8f0-478d-baa4-3c020c077e99"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:10:59.486324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:10:59.486324 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:10:59.495212 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a1bd27b6-3e00-486f-abb5-31a875ce2207 req-9e979a71-f1cb-4443-a38b-63b4b59d1e3a service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:10:59.495708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a1bd27b6-3e00-486f-abb5-31a875ce2207 req-9e979a71-f1cb-4443-a38b-63b4b59d1e3a service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:10:59.514357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-a1bd27b6-3e00-486f-abb5-31a875ce2207 req-9e979a71-f1cb-4443-a38b-63b4b59d1e3a service nova] Creating event network-changed:f82f881d-f8f0-478d-baa4-3c020c077e99 for instance add146c2-e4cc-491e-b5f9-17673e4a0c89 on hv-cinder-75790 Dec 03 15:10:59.521152 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-a1bd27b6-3e00-486f-abb5-31a875ce2207 req-9e979a71-f1cb-4443-a38b-63b4b59d1e3a service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049967 Dec 03 15:10:59.522080 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 481/983] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:10:59 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:11:00.493833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7efa0bc2-4009-4f31-ba3a-45123d95b339 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:00.494676 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7efa0bc2-4009-4f31-ba3a-45123d95b339 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:00.503777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7efa0bc2-4009-4f31-ba3a-45123d95b339 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:00.504290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7efa0bc2-4009-4f31-ba3a-45123d95b339 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:00.505197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7efa0bc2-4009-4f31-ba3a-45123d95b339 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:00.505691 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7efa0bc2-4009-4f31-ba3a-45123d95b339 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:00.591515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Updating instance_info_cache with network_info: [{"id": "f82f881d-f8f0-478d-baa4-3c020c077e99", "address": "fa:16:3e:2b:f6:08", "network": {"id": "0d922ba7-749c-4c5e-b6cc-12813984389c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1471273793-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f77c18074b76496dbbd6d15835f35760", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapf82f881d-f8", "ovs_interfaceid": "f82f881d-f8f0-478d-baa4-3c020c077e99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:11:00.602827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Releasing lock "refresh_cache-add146c2-e4cc-491e-b5f9-17673e4a0c89" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:11:00.603770 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-aaf4abce-96e3-4e43-b883-ed27d1139186 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "DELETE /compute/v2.1/os-floating-ips/dabc7193-4c3b-4928-bc01-be386314fe67" status: 202 len: 0 microversion: 2.1 time: 4.027403 Dec 03 15:11:00.604392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 503/984] 10.222.0.63 () {58 vars in 1253 bytes} [Thu Dec 3 15:10:56 2020] DELETE /compute/v2.1/os-floating-ips/dabc7193-4c3b-4928-bc01-be386314fe67 => generated 0 bytes in 4029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:11:00.619645 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b8e16334-5304-46cd-8e80-1943c0166403 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:00.620196 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b8e16334-5304-46cd-8e80-1943c0166403 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:00.629246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b8e16334-5304-46cd-8e80-1943c0166403 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:00.629682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b8e16334-5304-46cd-8e80-1943c0166403 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:00.630569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b8e16334-5304-46cd-8e80-1943c0166403 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:00.631288 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b8e16334-5304-46cd-8e80-1943c0166403 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:00.706972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b8e16334-5304-46cd-8e80-1943c0166403 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:11:00.741328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7efa0bc2-4009-4f31-ba3a-45123d95b339 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:00.767693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7efa0bc2-4009-4f31-ba3a-45123d95b339 tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1470 microversion: 2.1 time: 0.283959 Dec 03 15:11:00.768590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 482/985] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:00 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:00.987973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b8e16334-5304-46cd-8e80-1943c0166403 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "DELETE /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 204 len: 0 microversion: 2.1 time: 0.378331 Dec 03 15:11:00.989035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 504/986] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:11:00 2020] DELETE /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:11:01.004202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-31cab79e-26c3-4d5c-b314-7d803e5758b9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:01.004880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-31cab79e-26c3-4d5c-b314-7d803e5758b9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:01.013129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31cab79e-26c3-4d5c-b314-7d803e5758b9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:01.013642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31cab79e-26c3-4d5c-b314-7d803e5758b9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:01.015066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31cab79e-26c3-4d5c-b314-7d803e5758b9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:01.016200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-31cab79e-26c3-4d5c-b314-7d803e5758b9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:01.256438 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-31cab79e-26c3-4d5c-b314-7d803e5758b9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:01.265945 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-31cab79e-26c3-4d5c-b314-7d803e5758b9 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1455 microversion: 2.1 time: 0.272390 Dec 03 15:11:01.266579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 483/987] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:00 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1455 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:01.793110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f70b3b61-5157-44e2-b99b-01f61ea18e7e tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:01.793813 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f70b3b61-5157-44e2-b99b-01f61ea18e7e tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:01.802666 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f70b3b61-5157-44e2-b99b-01f61ea18e7e tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:01.803177 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f70b3b61-5157-44e2-b99b-01f61ea18e7e tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:01.804036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f70b3b61-5157-44e2-b99b-01f61ea18e7e tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:01.804537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f70b3b61-5157-44e2-b99b-01f61ea18e7e tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:02.249433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f70b3b61-5157-44e2-b99b-01f61ea18e7e tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:02.258768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f70b3b61-5157-44e2-b99b-01f61ea18e7e tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1470 microversion: 2.1 time: 0.475049 Dec 03 15:11:02.259358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 505/988] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:01 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1470 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:02.290368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c59eba06-0560-4a54-88b4-483a56619f14 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:02.291130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c59eba06-0560-4a54-88b4-483a56619f14 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:02.299271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c59eba06-0560-4a54-88b4-483a56619f14 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:02.299857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c59eba06-0560-4a54-88b4-483a56619f14 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:02.300771 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c59eba06-0560-4a54-88b4-483a56619f14 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:02.301331 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c59eba06-0560-4a54-88b4-483a56619f14 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:02.533199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-36e4b21a-5f10-43bb-b61c-727d20d382c7 req-f07cf2b4-aa9a-4986-a87d-bcef8678c630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fd5c24-95bc-4fe1-b71e-605a2c980760", "name": "network-vif-deleted", "tag": "3cc21dfe-f48a-4216-8892-7dae739356f2"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:11:02.548275 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c59eba06-0560-4a54-88b4-483a56619f14 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:02.564146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:11:02.564146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:11:02.564885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c59eba06-0560-4a54-88b4-483a56619f14 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1455 microversion: 2.1 time: 0.283260 Dec 03 15:11:02.575651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 484/989] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:02 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1455 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:02.579018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-36e4b21a-5f10-43bb-b61c-727d20d382c7 req-f07cf2b4-aa9a-4986-a87d-bcef8678c630 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:02.579707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-36e4b21a-5f10-43bb-b61c-727d20d382c7 req-f07cf2b4-aa9a-4986-a87d-bcef8678c630 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:02.600221 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-36e4b21a-5f10-43bb-b61c-727d20d382c7 req-f07cf2b4-aa9a-4986-a87d-bcef8678c630 service nova] Creating event network-vif-deleted:3cc21dfe-f48a-4216-8892-7dae739356f2 for instance 40fd5c24-95bc-4fe1-b71e-605a2c980760 on hv-cinder-75790 Dec 03 15:11:02.605568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-36e4b21a-5f10-43bb-b61c-727d20d382c7 req-f07cf2b4-aa9a-4986-a87d-bcef8678c630 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085614 Dec 03 15:11:02.606538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 506/990] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:11:02 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:11:03.283010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:03.283692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:03.291878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:03.292392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:03.293259 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:03.293757 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:03.380267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:03.381070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:03.381586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lazy-loading 'fault' on Instance uuid 40fd5c24-95bc-4fe1-b71e-605a2c980760 {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:11:03.453216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3329d958156244d3a7eb7ff342600720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860dd996f4a04eaaabea9a8cf042f3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:03.461419 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-df9ec0e9-f186-49cd-9f13-bff752a133ff tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 200 len: 1304 microversion: 2.1 time: 0.188475 Dec 03 15:11:03.462053 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 485/991] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:03 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:03.590383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-02165908-e151-4fc3-b2a7-dc505c5b5730 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:03.591155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-02165908-e151-4fc3-b2a7-dc505c5b5730 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:03.599521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02165908-e151-4fc3-b2a7-dc505c5b5730 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:03.600030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02165908-e151-4fc3-b2a7-dc505c5b5730 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:03.600882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02165908-e151-4fc3-b2a7-dc505c5b5730 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:03.601372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-02165908-e151-4fc3-b2a7-dc505c5b5730 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:04.218549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-02165908-e151-4fc3-b2a7-dc505c5b5730 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:04.228513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-02165908-e151-4fc3-b2a7-dc505c5b5730 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1455 microversion: 2.1 time: 0.647625 Dec 03 15:11:04.229532 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 507/992] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:03 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1455 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:04.485765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:04.486579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] [instance: 40fd5c24-95bc-4fe1-b71e-605a2c980760] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:04.495187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:04.495948 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:04.496882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:04.497472 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:04.553452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] HTTP exception thrown: Instance 40fd5c24-95bc-4fe1-b71e-605a2c980760 could not be found. Dec 03 15:11:04.554155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] Returning 404 to user: Instance 40fd5c24-95bc-4fe1-b71e-605a2c980760 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:11:04.555086 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-689ccd1e-0c79-468c-8301-34f80713546f tempest-VolumesNegativeTest-1740294801 tempest-VolumesNegativeTest-1740294801] 10.222.0.63 "GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760" status: 404 len: 111 microversion: 2.1 time: 0.078801 Dec 03 15:11:04.555694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 486/993] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:04 2020] GET /compute/v2.1/servers/40fd5c24-95bc-4fe1-b71e-605a2c980760 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:11:04.627081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-326dc8bf-e71c-453e-a51b-0489b8ea7e64 req-2745bdb0-8fb0-45d2-abcf-3d2a7bc57ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add146c2-e4cc-491e-b5f9-17673e4a0c89", "name": "network-vif-deleted", "tag": "f82f881d-f8f0-478d-baa4-3c020c077e99"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:11:04.634592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:11:04.634592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:11:04.644699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-326dc8bf-e71c-453e-a51b-0489b8ea7e64 req-2745bdb0-8fb0-45d2-abcf-3d2a7bc57ece service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:04.645479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-326dc8bf-e71c-453e-a51b-0489b8ea7e64 req-2745bdb0-8fb0-45d2-abcf-3d2a7bc57ece service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:04.663307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-326dc8bf-e71c-453e-a51b-0489b8ea7e64 req-2745bdb0-8fb0-45d2-abcf-3d2a7bc57ece service nova] Creating event network-vif-deleted:f82f881d-f8f0-478d-baa4-3c020c077e99 for instance add146c2-e4cc-491e-b5f9-17673e4a0c89 on hv-cinder-75790 Dec 03 15:11:04.668669 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-326dc8bf-e71c-453e-a51b-0489b8ea7e64 req-2745bdb0-8fb0-45d2-abcf-3d2a7bc57ece service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051868 Dec 03 15:11:04.669538 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 508/994] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:11:04 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:11:05.256388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:05.257254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:05.267195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:05.268073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:05.269564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:05.270287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:05.363944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:05.364452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:05.364961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lazy-loading 'fault' on Instance uuid add146c2-e4cc-491e-b5f9-17673e4a0c89 {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:11:05.443368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db41c9e650f8422f869cd588c90638a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77c18074b76496dbbd6d15835f35760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:05.453343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-91135871-8fc9-4e0d-b932-6365ea0165d4 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 200 len: 1225 microversion: 2.1 time: 0.209685 Dec 03 15:11:05.454363 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 487/995] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:05 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 1225 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:06.478526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:06.479285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] [instance: add146c2-e4cc-491e-b5f9-17673e4a0c89] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:06.488809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:06.489323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:06.490408 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:06.490694 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:06.544257 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] HTTP exception thrown: Instance add146c2-e4cc-491e-b5f9-17673e4a0c89 could not be found. Dec 03 15:11:06.544918 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Returning 404 to user: Instance add146c2-e4cc-491e-b5f9-17673e4a0c89 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:11:06.546482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b03e1d72-75e5-415e-80fc-1f7d066f8d79 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89" status: 404 len: 111 microversion: 2.1 time: 0.077641 Dec 03 15:11:06.547120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 509/996] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:06 2020] GET /compute/v2.1/servers/add146c2-e4cc-491e-b5f9-17673e4a0c89 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:11:06.564448 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8cddbb1d-d5b6-49cb-856f-1f3b45658063 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '.version_select at 0x7fd5f605bd90>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:06.865476 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8cddbb1d-d5b6-49cb-856f-1f3b45658063 tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "DELETE /compute/v2.1/os-security-groups/e36ef011-09e2-4558-934b-b2128a1b6126" status: 202 len: 0 microversion: 2.1 time: 0.312615 Dec 03 15:11:06.866708 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 488/997] 10.222.0.63 () {58 vars in 1262 bytes} [Thu Dec 3 15:11:06 2020] DELETE /compute/v2.1/os-security-groups/e36ef011-09e2-4558-934b-b2128a1b6126 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:11:06.880765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e9c705d9-20e7-44d7-b18d-62e56925764d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] Calling method '.version_select at 0x7fd5f5703d08>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:06.904251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e9c705d9-20e7-44d7-b18d-62e56925764d tempest-TestShelveInstance-812477412 tempest-TestShelveInstance-812477412] 10.222.0.63 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1271696383" status: 202 len: 0 microversion: 2.1 time: 0.033286 Dec 03 15:11:06.904850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 510/998] 10.222.0.63 () {58 vars in 1244 bytes} [Thu Dec 3 15:11:06 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1271696383 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:11:15.494582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-239295698", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "14aa4802-6c70-4c98-bcce-5e6e30e22a86"}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:11:15.641367 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] validate_networks() for [('14aa4802-6c70-4c98-bcce-5e6e30e22a86', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:11:16.195497 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:11:16.195972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:11:16.196512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:11:16.196973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:11:16.197433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:11:16.207355 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:16.207854 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:16.208722 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:16.209241 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:16.228181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Getting quotas for project 53373f86c5e745dea4811644f2dd6d54. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:11:16.232467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Getting quotas for user 141130b4926443c19522e8f41aca97dd and project 53373f86c5e745dea4811644f2dd6d54. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:11:16.243609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:11:16.246422 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:11:16.296224 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ef1c5012-d4d1-437c-b4a7-085fb4376702 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810707 Dec 03 15:11:16.296834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 489/999] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:11:15 2020] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:11:16.313060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1828545c-5813-493a-bb6c-271dbee9545d tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:16.314052 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1828545c-5813-493a-bb6c-271dbee9545d tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:16.549811 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1828545c-5813-493a-bb6c-271dbee9545d tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:16.560750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1828545c-5813-493a-bb6c-271dbee9545d tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1218 microversion: 2.1 time: 0.257380 Dec 03 15:11:16.561606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 511/1000] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:16 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:17.586309 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4e59175a-fd14-4029-93e2-755e18619515 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:17.586880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4e59175a-fd14-4029-93e2-755e18619515 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:17.596251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e59175a-fd14-4029-93e2-755e18619515 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:17.596744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e59175a-fd14-4029-93e2-755e18619515 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:17.597824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e59175a-fd14-4029-93e2-755e18619515 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:17.598604 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4e59175a-fd14-4029-93e2-755e18619515 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:17.749583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4e59175a-fd14-4029-93e2-755e18619515 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:17.774202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4e59175a-fd14-4029-93e2-755e18619515 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1278 microversion: 2.1 time: 0.198236 Dec 03 15:11:17.775362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 490/1001] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:17 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:18.805318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-aba503fc-8c68-4f3f-b4a3-57cb183fbf15 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:18.809439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-aba503fc-8c68-4f3f-b4a3-57cb183fbf15 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:18.827301 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aba503fc-8c68-4f3f-b4a3-57cb183fbf15 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:18.829329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aba503fc-8c68-4f3f-b4a3-57cb183fbf15 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:18.832412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aba503fc-8c68-4f3f-b4a3-57cb183fbf15 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:18.833267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aba503fc-8c68-4f3f-b4a3-57cb183fbf15 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:19.025375 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-aba503fc-8c68-4f3f-b4a3-57cb183fbf15 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:19.044148 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-aba503fc-8c68-4f3f-b4a3-57cb183fbf15 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1276 microversion: 2.1 time: 0.251030 Dec 03 15:11:19.045664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 512/1002] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:18 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:20.070111 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-74dd0bd1-5c8f-4529-8f51-bed13d02be84 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:20.071512 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-74dd0bd1-5c8f-4529-8f51-bed13d02be84 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:20.081390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-74dd0bd1-5c8f-4529-8f51-bed13d02be84 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:20.082081 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-74dd0bd1-5c8f-4529-8f51-bed13d02be84 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:20.083268 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-74dd0bd1-5c8f-4529-8f51-bed13d02be84 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:20.083832 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-74dd0bd1-5c8f-4529-8f51-bed13d02be84 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:20.960149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-74dd0bd1-5c8f-4529-8f51-bed13d02be84 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:20.971564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-74dd0bd1-5c8f-4529-8f51-bed13d02be84 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1318 microversion: 2.1 time: 0.912210 Dec 03 15:11:20.972189 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 491/1003] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:20 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1318 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:21.582376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-cdd00d52-046c-4a34-ac08-73f167bb3f9a req-9ba668b9-e07a-4d2d-bc84-8b9572404e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38dcde0e-5f69-4037-be95-c6e71867a5b9", "tag": "417007a1-11b4-4db5-a62d-55d18edf3dee"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:11:21.590315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:11:21.590315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:11:21.599640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-cdd00d52-046c-4a34-ac08-73f167bb3f9a req-9ba668b9-e07a-4d2d-bc84-8b9572404e85 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:21.600063 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-cdd00d52-046c-4a34-ac08-73f167bb3f9a req-9ba668b9-e07a-4d2d-bc84-8b9572404e85 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:21.619290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-cdd00d52-046c-4a34-ac08-73f167bb3f9a req-9ba668b9-e07a-4d2d-bc84-8b9572404e85 service nova] Creating event network-changed:417007a1-11b4-4db5-a62d-55d18edf3dee for instance 38dcde0e-5f69-4037-be95-c6e71867a5b9 on hv-cinder-75790 Dec 03 15:11:21.625007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-cdd00d52-046c-4a34-ac08-73f167bb3f9a req-9ba668b9-e07a-4d2d-bc84-8b9572404e85 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053697 Dec 03 15:11:21.625007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 513/1004] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:11:21 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:11:21.996932 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-41075db6-81cb-411c-82a1-977237e17838 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:22.000659 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-41075db6-81cb-411c-82a1-977237e17838 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:22.019483 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41075db6-81cb-411c-82a1-977237e17838 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:22.019990 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41075db6-81cb-411c-82a1-977237e17838 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:22.020855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41075db6-81cb-411c-82a1-977237e17838 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:22.021350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-41075db6-81cb-411c-82a1-977237e17838 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:22.573439 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-41075db6-81cb-411c-82a1-977237e17838 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:22.585890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-41075db6-81cb-411c-82a1-977237e17838 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1318 microversion: 2.1 time: 0.600490 Dec 03 15:11:22.586908 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 492/1005] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:21 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:23.610858 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-76dfc25e-c81c-4f51-8954-6ce0c55e3653 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:23.611583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-76dfc25e-c81c-4f51-8954-6ce0c55e3653 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:23.619745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-76dfc25e-c81c-4f51-8954-6ce0c55e3653 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:23.620232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-76dfc25e-c81c-4f51-8954-6ce0c55e3653 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:23.621260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-76dfc25e-c81c-4f51-8954-6ce0c55e3653 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:23.621756 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-76dfc25e-c81c-4f51-8954-6ce0c55e3653 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:23.970532 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-76dfc25e-c81c-4f51-8954-6ce0c55e3653 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:23.980901 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-76dfc25e-c81c-4f51-8954-6ce0c55e3653 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1318 microversion: 2.1 time: 0.380374 Dec 03 15:11:23.981768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 514/1006] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:23 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:25.017859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0a149b1a-53ed-4922-b773-df08cfb0688c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:25.019952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0a149b1a-53ed-4922-b773-df08cfb0688c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:25.036033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0a149b1a-53ed-4922-b773-df08cfb0688c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:25.037232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0a149b1a-53ed-4922-b773-df08cfb0688c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:25.039136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0a149b1a-53ed-4922-b773-df08cfb0688c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:25.040451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0a149b1a-53ed-4922-b773-df08cfb0688c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:25.278606 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-8e9df0af-8d50-4dcc-99cd-21e7dfb6b17b req-352677cd-0b8c-4dc9-aefb-f399b67a5aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dcde0e-5f69-4037-be95-c6e71867a5b9", "name": "network-vif-plugged", "status": "completed", "tag": "417007a1-11b4-4db5-a62d-55d18edf3dee"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:11:25.292430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:11:25.292430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:11:25.302784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-8e9df0af-8d50-4dcc-99cd-21e7dfb6b17b req-352677cd-0b8c-4dc9-aefb-f399b67a5aec service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:25.304278 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-8e9df0af-8d50-4dcc-99cd-21e7dfb6b17b req-352677cd-0b8c-4dc9-aefb-f399b67a5aec service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:25.326557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0a149b1a-53ed-4922-b773-df08cfb0688c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:25.344498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0a149b1a-53ed-4922-b773-df08cfb0688c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1318 microversion: 2.1 time: 0.346703 Dec 03 15:11:25.357291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 493/1007] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:24 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:25.364877 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-8e9df0af-8d50-4dcc-99cd-21e7dfb6b17b req-352677cd-0b8c-4dc9-aefb-f399b67a5aec service nova] Creating event network-vif-plugged:417007a1-11b4-4db5-a62d-55d18edf3dee for instance 38dcde0e-5f69-4037-be95-c6e71867a5b9 on hv-cinder-75790 Dec 03 15:11:25.371802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-8e9df0af-8d50-4dcc-99cd-21e7dfb6b17b req-352677cd-0b8c-4dc9-aefb-f399b67a5aec service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108287 Dec 03 15:11:25.373441 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 515/1008] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:11:25 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:11:26.367651 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3b3afc9b-8775-4986-a0ff-018c79d39467 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:26.368315 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3b3afc9b-8775-4986-a0ff-018c79d39467 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:26.376750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b3afc9b-8775-4986-a0ff-018c79d39467 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:26.377251 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b3afc9b-8775-4986-a0ff-018c79d39467 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:26.378145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b3afc9b-8775-4986-a0ff-018c79d39467 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:26.378631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3b3afc9b-8775-4986-a0ff-018c79d39467 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:26.600790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-3b3afc9b-8775-4986-a0ff-018c79d39467 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:26.610721 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3b3afc9b-8775-4986-a0ff-018c79d39467 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1318 microversion: 2.1 time: 0.252304 Dec 03 15:11:26.611333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 494/1009] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:26 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:27.634250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0a8c30ff-8227-4836-922f-419f12275ad7 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:11:27.635008 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0a8c30ff-8227-4836-922f-419f12275ad7 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:27.643187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0a8c30ff-8227-4836-922f-419f12275ad7 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:27.643687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0a8c30ff-8227-4836-922f-419f12275ad7 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:27.644521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0a8c30ff-8227-4836-922f-419f12275ad7 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:27.645012 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0a8c30ff-8227-4836-922f-419f12275ad7 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:27.868000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0a8c30ff-8227-4836-922f-419f12275ad7 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:11:27.877655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0a8c30ff-8227-4836-922f-419f12275ad7 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1507 microversion: 2.1 time: 0.253075 Dec 03 15:11:27.878310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 516/1010] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:11:27 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:11:46.181535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-95051cf7-7537-45ae-a845-2021992eef24 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91be332d-c424-46ed-b783-f2c7b8b30a4f", "device": "/dev/sdb"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:11:46.183588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-95051cf7-7537-45ae-a845-2021992eef24 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:11:46.192461 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-95051cf7-7537-45ae-a845-2021992eef24 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:46.192964 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-95051cf7-7537-45ae-a845-2021992eef24 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:46.193794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-95051cf7-7537-45ae-a845-2021992eef24 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:11:46.194304 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-95051cf7-7537-45ae-a845-2021992eef24 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:11:46.580143 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-95051cf7-7537-45ae-a845-2021992eef24 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "POST /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407599 Dec 03 15:11:46.580743 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 495/1011] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:11:46 2020] POST /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:12:10.322024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e1d4f460-0048-427b-a4d5-590f17954f91 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:10.322554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e1d4f460-0048-427b-a4d5-590f17954f91 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:10.331211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1d4f460-0048-427b-a4d5-590f17954f91 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:10.331715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1d4f460-0048-427b-a4d5-590f17954f91 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:10.332546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1d4f460-0048-427b-a4d5-590f17954f91 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:10.333035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e1d4f460-0048-427b-a4d5-590f17954f91 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:10.596707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e1d4f460-0048-427b-a4d5-590f17954f91 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "DELETE /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9/os-volume_attachments/91be332d-c424-46ed-b783-f2c7b8b30a4f" status: 202 len: 0 microversion: 2.1 time: 0.284297 Dec 03 15:12:10.597345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 517/1012] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:12:10 2020] DELETE /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9/os-volume_attachments/91be332d-c424-46ed-b783-f2c7b8b30a4f => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:12:11.825862 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a068dcf6-008b-4263-adbe-fd138f4d5a70 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:11.826477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a068dcf6-008b-4263-adbe-fd138f4d5a70 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:11.836499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a068dcf6-008b-4263-adbe-fd138f4d5a70 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:11.837004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a068dcf6-008b-4263-adbe-fd138f4d5a70 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:11.837853 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a068dcf6-008b-4263-adbe-fd138f4d5a70 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:11.838400 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a068dcf6-008b-4263-adbe-fd138f4d5a70 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:11.912435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a068dcf6-008b-4263-adbe-fd138f4d5a70 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:12:12.028593 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a068dcf6-008b-4263-adbe-fd138f4d5a70 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "DELETE /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 204 len: 0 microversion: 2.1 time: 0.215983 Dec 03 15:12:12.029260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 496/1013] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:12:11 2020] DELETE /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:12:12.044635 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b7c282e2-4125-41bb-8f2c-a1defd02a94c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:12.045409 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b7c282e2-4125-41bb-8f2c-a1defd02a94c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:12.053647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7c282e2-4125-41bb-8f2c-a1defd02a94c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:12.054186 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7c282e2-4125-41bb-8f2c-a1defd02a94c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:12.055036 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7c282e2-4125-41bb-8f2c-a1defd02a94c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:12.055534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7c282e2-4125-41bb-8f2c-a1defd02a94c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:12.280803 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b7c282e2-4125-41bb-8f2c-a1defd02a94c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:12.289682 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b7c282e2-4125-41bb-8f2c-a1defd02a94c tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1513 microversion: 2.1 time: 0.254932 Dec 03 15:12:12.290345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 518/1014] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:12 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:13.315075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-45ef0dc7-861c-485d-99a0-fe84914fee4b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:13.315845 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-45ef0dc7-861c-485d-99a0-fe84914fee4b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:13.323693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-45ef0dc7-861c-485d-99a0-fe84914fee4b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:13.324199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-45ef0dc7-861c-485d-99a0-fe84914fee4b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:13.325029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-45ef0dc7-861c-485d-99a0-fe84914fee4b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:13.325515 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-45ef0dc7-861c-485d-99a0-fe84914fee4b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:13.810548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-45ef0dc7-861c-485d-99a0-fe84914fee4b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:13.820163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-45ef0dc7-861c-485d-99a0-fe84914fee4b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1513 microversion: 2.1 time: 0.515666 Dec 03 15:12:13.820756 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 497/1015] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:13 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1513 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:14.843401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4d4982e1-9990-4ebc-a9e5-9c57e9316aaa tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:14.844274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4d4982e1-9990-4ebc-a9e5-9c57e9316aaa tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:14.852327 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d4982e1-9990-4ebc-a9e5-9c57e9316aaa tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:14.852840 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d4982e1-9990-4ebc-a9e5-9c57e9316aaa tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:14.853786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d4982e1-9990-4ebc-a9e5-9c57e9316aaa tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:14.854311 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d4982e1-9990-4ebc-a9e5-9c57e9316aaa tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:15.092222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-a46d5c0a-fe0e-478f-91bb-8abd2a6815e8 req-eb91b5a1-fb68-42d4-b9b0-a02e38874318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dcde0e-5f69-4037-be95-c6e71867a5b9", "name": "network-vif-deleted", "tag": "417007a1-11b4-4db5-a62d-55d18edf3dee"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:12:15.099640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:12:15.099640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:12:15.100783 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4d4982e1-9990-4ebc-a9e5-9c57e9316aaa tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:15.111225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a46d5c0a-fe0e-478f-91bb-8abd2a6815e8 req-eb91b5a1-fb68-42d4-b9b0-a02e38874318 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:15.111730 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a46d5c0a-fe0e-478f-91bb-8abd2a6815e8 req-eb91b5a1-fb68-42d4-b9b0-a02e38874318 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:15.111938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4d4982e1-9990-4ebc-a9e5-9c57e9316aaa tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 200 len: 1471 microversion: 2.1 time: 0.278094 Dec 03 15:12:15.113115 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 519/1016] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:14 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:15.131066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-a46d5c0a-fe0e-478f-91bb-8abd2a6815e8 req-eb91b5a1-fb68-42d4-b9b0-a02e38874318 service nova] Creating event network-vif-deleted:417007a1-11b4-4db5-a62d-55d18edf3dee for instance 38dcde0e-5f69-4037-be95-c6e71867a5b9 on hv-cinder-75790 Dec 03 15:12:15.136430 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-a46d5c0a-fe0e-478f-91bb-8abd2a6815e8 req-eb91b5a1-fb68-42d4-b9b0-a02e38874318 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053653 Dec 03 15:12:15.137108 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 498/1017] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:12:15 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:12:16.137329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:16.137931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 38dcde0e-5f69-4037-be95-c6e71867a5b9] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:16.146535 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:16.147039 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:16.147873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:16.148361 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:16.200509 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] HTTP exception thrown: Instance 38dcde0e-5f69-4037-be95-c6e71867a5b9 could not be found. Dec 03 15:12:16.201159 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Returning 404 to user: Instance 38dcde0e-5f69-4037-be95-c6e71867a5b9 could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:12:16.202075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8c3370f1-33d3-4e64-adff-0ae122d8d3f1 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9" status: 404 len: 111 microversion: 2.1 time: 0.074115 Dec 03 15:12:16.202688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 520/1018] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:16 2020] GET /compute/v2.1/servers/38dcde0e-5f69-4037-be95-c6e71867a5b9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:12:24.585584 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1362291739", "imageRef": "1d47f30e-ea91-4225-bfa6-486044e88e6d", "flavorRef": "452", "networks": [{"uuid": "14aa4802-6c70-4c98-bcce-5e6e30e22a86"}]}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:12:24.666688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] validate_networks() for [('14aa4802-6c70-4c98-bcce-5e6e30e22a86', None, None, None)] {{(pid=94373) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:12:25.193530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Flavor limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:12:25.194076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Image limits 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:12:25.194663 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Flavor pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:12:25.195119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Image pref 0:0:0 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:12:25.195575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:12:25.204619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:25.205117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:25.206031 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:25.206516 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:25.224952 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Getting quotas for project 53373f86c5e745dea4811644f2dd6d54. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:12:25.229191 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Getting quotas for user 141130b4926443c19522e8f41aca97dd and project 53373f86c5e745dea4811644f2dd6d54. Resources: {'cores', 'instances', 'ram'} {{(pid=94373) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:12:25.240951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Going to run 1 instances... {{(pid=94373) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:12:25.243634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d47f30e-ea91-4225-bfa6-486044e88e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:12:25.293388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0b43505e-5f91-474a-acdc-73288747b9c9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718696 Dec 03 15:12:25.294112 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 499/1019] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:12:24 2020] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:12:25.313598 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-244b26b7-f348-4b56-b936-94d116c1ec42 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:25.314249 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-244b26b7-f348-4b56-b936-94d116c1ec42 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:25.423796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-244b26b7-f348-4b56-b936-94d116c1ec42 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:25.431849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-244b26b7-f348-4b56-b936-94d116c1ec42 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1219 microversion: 2.1 time: 0.127931 Dec 03 15:12:25.432533 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 521/1020] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:25 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:26.457399 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b575105b-9ba1-46eb-b561-867a62ba1a0e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:26.458292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b575105b-9ba1-46eb-b561-867a62ba1a0e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:26.466815 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b575105b-9ba1-46eb-b561-867a62ba1a0e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:26.467333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b575105b-9ba1-46eb-b561-867a62ba1a0e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:26.468458 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b575105b-9ba1-46eb-b561-867a62ba1a0e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:26.469628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b575105b-9ba1-46eb-b561-867a62ba1a0e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:26.611373 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-b575105b-9ba1-46eb-b561-867a62ba1a0e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:26.622705 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b575105b-9ba1-46eb-b561-867a62ba1a0e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1289 microversion: 2.1 time: 0.175579 Dec 03 15:12:26.623332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 500/1021] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:26 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1289 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:27.646857 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-55bec915-ad83-499b-97f4-4febd6cec5d2 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:27.647529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-55bec915-ad83-499b-97f4-4febd6cec5d2 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:27.656010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55bec915-ad83-499b-97f4-4febd6cec5d2 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:27.656657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55bec915-ad83-499b-97f4-4febd6cec5d2 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:27.657640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55bec915-ad83-499b-97f4-4febd6cec5d2 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:27.658168 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-55bec915-ad83-499b-97f4-4febd6cec5d2 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:28.102457 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-55bec915-ad83-499b-97f4-4febd6cec5d2 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:28.112307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-55bec915-ad83-499b-97f4-4febd6cec5d2 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1319 microversion: 2.1 time: 0.475352 Dec 03 15:12:28.112962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 522/1022] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:27 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:29.137790 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5fa1f609-7ff4-4065-b174-6716fa2dce0b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:29.138616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5fa1f609-7ff4-4065-b174-6716fa2dce0b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:29.147059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5fa1f609-7ff4-4065-b174-6716fa2dce0b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:29.147671 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5fa1f609-7ff4-4065-b174-6716fa2dce0b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:29.148524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5fa1f609-7ff4-4065-b174-6716fa2dce0b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:29.149010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5fa1f609-7ff4-4065-b174-6716fa2dce0b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:29.207479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-f1097191-0b3b-4fbc-b35d-ca77c332b7c4 req-92c88a64-712f-464e-b1ca-8f6e145bc7cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bac5f0-bc0a-483a-8511-637e1982d655", "tag": "32c33f5f-f535-4def-8119-5ec04e44c6df"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:12:29.214395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:12:29.214395 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:12:29.223453 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f1097191-0b3b-4fbc-b35d-ca77c332b7c4 req-92c88a64-712f-464e-b1ca-8f6e145bc7cf service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:29.224092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f1097191-0b3b-4fbc-b35d-ca77c332b7c4 req-92c88a64-712f-464e-b1ca-8f6e145bc7cf service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:29.241989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-f1097191-0b3b-4fbc-b35d-ca77c332b7c4 req-92c88a64-712f-464e-b1ca-8f6e145bc7cf service nova] Creating event network-changed:32c33f5f-f535-4def-8119-5ec04e44c6df for instance 24bac5f0-bc0a-483a-8511-637e1982d655 on hv-cinder-75790 Dec 03 15:12:29.246838 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-f1097191-0b3b-4fbc-b35d-ca77c332b7c4 req-92c88a64-712f-464e-b1ca-8f6e145bc7cf service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049661 Dec 03 15:12:29.247667 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 523/1023] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:12:29 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:12:29.382699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5fa1f609-7ff4-4065-b174-6716fa2dce0b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:29.392145 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5fa1f609-7ff4-4065-b174-6716fa2dce0b tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1319 microversion: 2.1 time: 0.264123 Dec 03 15:12:29.392963 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 501/1024] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:29 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:30.409203 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76f3452b-52ff-4871-aeaf-c73b4d70f369] AMQP server on 10.222.0.63:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 03 15:12:30.418388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e6556fc7-7a53-4a21-a98d-3a76a8391ef9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:30.419161 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e6556fc7-7a53-4a21-a98d-3a76a8391ef9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:30.427492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6556fc7-7a53-4a21-a98d-3a76a8391ef9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:30.428005 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6556fc7-7a53-4a21-a98d-3a76a8391ef9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:30.428849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6556fc7-7a53-4a21-a98d-3a76a8391ef9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:30.429343 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e6556fc7-7a53-4a21-a98d-3a76a8391ef9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:30.773282 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e6556fc7-7a53-4a21-a98d-3a76a8391ef9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:30.782312 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e6556fc7-7a53-4a21-a98d-3a76a8391ef9 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1319 microversion: 2.1 time: 0.374758 Dec 03 15:12:30.782914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 524/1025] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:30 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:31.806779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-78854782-b1e4-4128-8426-32e800807999 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:31.807451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-78854782-b1e4-4128-8426-32e800807999 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:31.817737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78854782-b1e4-4128-8426-32e800807999 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:31.818566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78854782-b1e4-4128-8426-32e800807999 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:31.819947 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78854782-b1e4-4128-8426-32e800807999 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:31.820744 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-78854782-b1e4-4128-8426-32e800807999 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:32.057700 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-78854782-b1e4-4128-8426-32e800807999 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:32.066960 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-78854782-b1e4-4128-8426-32e800807999 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1319 microversion: 2.1 time: 0.270186 Dec 03 15:12:32.067568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 502/1026] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:31 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:33.091582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e61b7f05-7447-45c5-93fd-e2cfd91935fc tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:33.092256 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e61b7f05-7447-45c5-93fd-e2cfd91935fc tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:33.112260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e61b7f05-7447-45c5-93fd-e2cfd91935fc tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:33.112765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e61b7f05-7447-45c5-93fd-e2cfd91935fc tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:33.113631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e61b7f05-7447-45c5-93fd-e2cfd91935fc tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:33.114149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e61b7f05-7447-45c5-93fd-e2cfd91935fc tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:33.151116 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] [76f3452b-52ff-4871-aeaf-c73b4d70f369] Reconnected to AMQP server on 10.222.0.63:5672 via [amqp] client with port 52678. Dec 03 15:12:33.222446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-a7841578-7986-4ae3-ab22-080c817a50e6 req-8535ebdf-c002-403e-8c9c-0ae5a5769d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bac5f0-bc0a-483a-8511-637e1982d655", "name": "network-vif-plugged", "status": "completed", "tag": "32c33f5f-f535-4def-8119-5ec04e44c6df"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:12:33.229243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:12:33.229243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:12:33.239796 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a7841578-7986-4ae3-ab22-080c817a50e6 req-8535ebdf-c002-403e-8c9c-0ae5a5769d68 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:33.240298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-a7841578-7986-4ae3-ab22-080c817a50e6 req-8535ebdf-c002-403e-8c9c-0ae5a5769d68 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:33.259217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-a7841578-7986-4ae3-ab22-080c817a50e6 req-8535ebdf-c002-403e-8c9c-0ae5a5769d68 service nova] Creating event network-vif-plugged:32c33f5f-f535-4def-8119-5ec04e44c6df for instance 24bac5f0-bc0a-483a-8511-637e1982d655 on hv-cinder-75790 Dec 03 15:12:33.265095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-a7841578-7986-4ae3-ab22-080c817a50e6 req-8535ebdf-c002-403e-8c9c-0ae5a5769d68 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051762 Dec 03 15:12:33.265802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 503/1027] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:12:33 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:12:33.346305 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e61b7f05-7447-45c5-93fd-e2cfd91935fc tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:33.355089 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e61b7f05-7447-45c5-93fd-e2cfd91935fc tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1319 microversion: 2.1 time: 0.273364 Dec 03 15:12:33.355692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 525/1028] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:33 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:34.381007 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9748b15a-4a6d-4944-b121-325f19b3715e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:34.381786 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9748b15a-4a6d-4944-b121-325f19b3715e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:34.390001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9748b15a-4a6d-4944-b121-325f19b3715e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:34.391173 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9748b15a-4a6d-4944-b121-325f19b3715e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:34.392033 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9748b15a-4a6d-4944-b121-325f19b3715e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:34.392525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9748b15a-4a6d-4944-b121-325f19b3715e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:34.619297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9748b15a-4a6d-4944-b121-325f19b3715e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:34.627345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9748b15a-4a6d-4944-b121-325f19b3715e tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1319 microversion: 2.1 time: 0.256935 Dec 03 15:12:34.627961 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 504/1029] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:34 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:35.650746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-60e3e465-7bad-4b9e-81b2-43a374bc06f6 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:35.651416 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-60e3e465-7bad-4b9e-81b2-43a374bc06f6 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:35.659554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60e3e465-7bad-4b9e-81b2-43a374bc06f6 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:35.660067 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60e3e465-7bad-4b9e-81b2-43a374bc06f6 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:35.660910 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60e3e465-7bad-4b9e-81b2-43a374bc06f6 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:35.661402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60e3e465-7bad-4b9e-81b2-43a374bc06f6 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:35.882362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-60e3e465-7bad-4b9e-81b2-43a374bc06f6 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:35.891537 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-60e3e465-7bad-4b9e-81b2-43a374bc06f6 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1509 microversion: 2.1 time: 0.250050 Dec 03 15:12:35.892132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 526/1030] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:35 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:35.915133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-aa89d835-d3ca-47a9-84d4-06816964e6b4 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3a14b7a-3f3c-46af-b010-a759770be433", "device": "/dev/sdb"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:12:35.916359 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-aa89d835-d3ca-47a9-84d4-06816964e6b4 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:35.924832 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aa89d835-d3ca-47a9-84d4-06816964e6b4 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:35.925329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aa89d835-d3ca-47a9-84d4-06816964e6b4 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:35.926183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aa89d835-d3ca-47a9-84d4-06816964e6b4 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:35.926665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-aa89d835-d3ca-47a9-84d4-06816964e6b4 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:36.318909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-aa89d835-d3ca-47a9-84d4-06816964e6b4 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "POST /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413342 Dec 03 15:12:36.319573 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 505/1031] 10.222.0.63 () {60 vars in 1313 bytes} [Thu Dec 3 15:12:35 2020] POST /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:12:42.487002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e3cfb21d-5838-4d8d-a1b8-8fbf9fc7620b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:42.487616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e3cfb21d-5838-4d8d-a1b8-8fbf9fc7620b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:42.495358 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e3cfb21d-5838-4d8d-a1b8-8fbf9fc7620b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:42.495860 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e3cfb21d-5838-4d8d-a1b8-8fbf9fc7620b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:42.496704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e3cfb21d-5838-4d8d-a1b8-8fbf9fc7620b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:42.497195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e3cfb21d-5838-4d8d-a1b8-8fbf9fc7620b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:42.572106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e3cfb21d-5838-4d8d-a1b8-8fbf9fc7620b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:12:42.696988 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e3cfb21d-5838-4d8d-a1b8-8fbf9fc7620b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 204 len: 0 microversion: 2.1 time: 0.219388 Dec 03 15:12:42.697711 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 527/1032] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:12:42 2020] DELETE /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:12:42.713119 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-7d61060d-d597-4b1d-ab5b-532099cf1e03 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:42.713899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-7d61060d-d597-4b1d-ab5b-532099cf1e03 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:42.723619 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7d61060d-d597-4b1d-ab5b-532099cf1e03 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:42.724131 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7d61060d-d597-4b1d-ab5b-532099cf1e03 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:42.724980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7d61060d-d597-4b1d-ab5b-532099cf1e03 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:42.725521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-7d61060d-d597-4b1d-ab5b-532099cf1e03 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:42.956525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-7d61060d-d597-4b1d-ab5b-532099cf1e03 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:42.965709 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-7d61060d-d597-4b1d-ab5b-532099cf1e03 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1585 microversion: 2.1 time: 0.263005 Dec 03 15:12:42.967195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 506/1033] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:42 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1585 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:43.990951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-60a09e24-0bf8-4622-811e-11d3e590f776 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:43.991642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-60a09e24-0bf8-4622-811e-11d3e590f776 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:43.999479 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60a09e24-0bf8-4622-811e-11d3e590f776 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:44.000136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60a09e24-0bf8-4622-811e-11d3e590f776 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:44.000978 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60a09e24-0bf8-4622-811e-11d3e590f776 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:44.001477 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-60a09e24-0bf8-4622-811e-11d3e590f776 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:44.232416 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-60a09e24-0bf8-4622-811e-11d3e590f776 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:44.242193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-60a09e24-0bf8-4622-811e-11d3e590f776 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1585 microversion: 2.1 time: 0.261492 Dec 03 15:12:44.242760 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 528/1034] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:43 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1585 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:45.265976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-676369c6-649c-4836-a0d8-dee6fe93dd43 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:45.266776 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-676369c6-649c-4836-a0d8-dee6fe93dd43 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:45.275279 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-676369c6-649c-4836-a0d8-dee6fe93dd43 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:45.275784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-676369c6-649c-4836-a0d8-dee6fe93dd43 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:45.276636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-676369c6-649c-4836-a0d8-dee6fe93dd43 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:45.277126 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-676369c6-649c-4836-a0d8-dee6fe93dd43 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:45.497132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-676369c6-649c-4836-a0d8-dee6fe93dd43 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:45.507886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-676369c6-649c-4836-a0d8-dee6fe93dd43 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1585 microversion: 2.1 time: 0.251279 Dec 03 15:12:45.508613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 507/1035] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:45 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1585 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:46.303930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-31c1db94-e3a0-46b8-9a55-6e709491ab02 req-7af712d7-a044-4d74-9127-4d934897a499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0423581-5320-4d03-8e5c-2fc88bf1837b", "name": "network-vif-deleted", "tag": "1d444986-6670-4748-b35e-a5b3b20c3660"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:12:46.312921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:12:46.312921 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:12:46.323842 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-31c1db94-e3a0-46b8-9a55-6e709491ab02 req-7af712d7-a044-4d74-9127-4d934897a499 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:46.324434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-31c1db94-e3a0-46b8-9a55-6e709491ab02 req-7af712d7-a044-4d74-9127-4d934897a499 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:46.343915 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-31c1db94-e3a0-46b8-9a55-6e709491ab02 req-7af712d7-a044-4d74-9127-4d934897a499 service nova] Creating event network-vif-deleted:1d444986-6670-4748-b35e-a5b3b20c3660 for instance f0423581-5320-4d03-8e5c-2fc88bf1837b on hv-cinder-75790 Dec 03 15:12:46.349208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-31c1db94-e3a0-46b8-9a55-6e709491ab02 req-7af712d7-a044-4d74-9127-4d934897a499 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056859 Dec 03 15:12:46.350116 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 529/1036] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:12:46 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:12:46.534239 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8f5ca711-85c6-4004-8e12-a886fd0c8034 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:46.534929 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8f5ca711-85c6-4004-8e12-a886fd0c8034 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:46.543146 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f5ca711-85c6-4004-8e12-a886fd0c8034 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:46.543664 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f5ca711-85c6-4004-8e12-a886fd0c8034 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:46.544523 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f5ca711-85c6-4004-8e12-a886fd0c8034 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:46.545018 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8f5ca711-85c6-4004-8e12-a886fd0c8034 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:46.681180 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8f5ca711-85c6-4004-8e12-a886fd0c8034 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:46.690437 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8f5ca711-85c6-4004-8e12-a886fd0c8034 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1510 microversion: 2.1 time: 0.167585 Dec 03 15:12:46.691047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 508/1037] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:46 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:47.715449 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bf137ae5-76eb-497e-8bfa-1b895d6c3d79 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:47.716225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bf137ae5-76eb-497e-8bfa-1b895d6c3d79 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:47.725073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bf137ae5-76eb-497e-8bfa-1b895d6c3d79 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:47.725579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bf137ae5-76eb-497e-8bfa-1b895d6c3d79 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:47.726496 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bf137ae5-76eb-497e-8bfa-1b895d6c3d79 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:47.726989 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bf137ae5-76eb-497e-8bfa-1b895d6c3d79 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:47.880297 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bf137ae5-76eb-497e-8bfa-1b895d6c3d79 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:47.889187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bf137ae5-76eb-497e-8bfa-1b895d6c3d79 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 200 len: 1225 microversion: 2.1 time: 0.184415 Dec 03 15:12:47.889787 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 530/1038] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:47 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 1225 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:48.913384 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:48.914082 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:48.921937 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:48.922474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:48.923308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:48.923794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:48.979817 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] HTTP exception thrown: Instance f0423581-5320-4d03-8e5c-2fc88bf1837b could not be found. Dec 03 15:12:48.980487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Returning 404 to user: Instance f0423581-5320-4d03-8e5c-2fc88bf1837b could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:12:48.981435 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fa6560a9-83fa-4283-a05b-eb17c5cd80d5 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 404 len: 111 microversion: 2.1 time: 0.077985 Dec 03 15:12:48.982088 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 509/1039] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:48 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:12:49.182129 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2005894896", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415978198", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1253914480"}], "block_device_mapping_v2": [{"uuid": "b499728d-a714-4a55-b77e-eaba9d4884c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca7902d6-3500-4f57-934f-b73bb22a6c84"}]}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:12:49.370172 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] validate_networks() for [('ca7902d6-3500-4f57-934f-b73bb22a6c84', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:12:49.945168 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:12:49.945649 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:12:49.946202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:12:49.946669 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:12:49.947135 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:12:49.956801 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:49.957308 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:49.958217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:49.958715 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:49.977696 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for project f470bb55fd724a97959cc14ef30e0db0. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:12:49.982038 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for user c3ba93c0e7ce4b0598807e3e3e2ec74a and project f470bb55fd724a97959cc14ef30e0db0. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:12:50.089856 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:12:50.092427 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b499728d-a714-4a55-b77e-eaba9d4884c3',volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:12:50.281291 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5d777a28-a25d-400b-94e6-609e7f683e32 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.108665 Dec 03 15:12:50.282042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 531/1040] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:12:49 2020] POST /compute/v2.1/servers => generated 413 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:12:50.298009 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ff8ff50c-9593-47fb-ab76-7b20db39b90d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:50.298690 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ff8ff50c-9593-47fb-ab76-7b20db39b90d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:50.385974 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ff8ff50c-9593-47fb-ab76-7b20db39b90d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:50.395798 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ff8ff50c-9593-47fb-ab76-7b20db39b90d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1094 microversion: 2.1 time: 0.106993 Dec 03 15:12:50.396415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 510/1041] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:50 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:51.420165 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c3561687-22e5-4b6c-9677-bb9cf20ba9ad tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:51.420834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c3561687-22e5-4b6c-9677-bb9cf20ba9ad tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:51.429443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c3561687-22e5-4b6c-9677-bb9cf20ba9ad tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:51.430028 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c3561687-22e5-4b6c-9677-bb9cf20ba9ad tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:51.430868 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c3561687-22e5-4b6c-9677-bb9cf20ba9ad tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:51.431362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c3561687-22e5-4b6c-9677-bb9cf20ba9ad tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:51.563463 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c3561687-22e5-4b6c-9677-bb9cf20ba9ad tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:51.572318 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c3561687-22e5-4b6c-9677-bb9cf20ba9ad tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1144 microversion: 2.1 time: 0.161318 Dec 03 15:12:51.572909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 532/1042] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:51 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1144 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:52.596880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9b2c9943-659a-4cf8-a27f-28783f3bf678 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:52.597548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9b2c9943-659a-4cf8-a27f-28783f3bf678 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:52.610376 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b2c9943-659a-4cf8-a27f-28783f3bf678 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:52.611124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b2c9943-659a-4cf8-a27f-28783f3bf678 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:52.612000 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b2c9943-659a-4cf8-a27f-28783f3bf678 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:52.612505 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9b2c9943-659a-4cf8-a27f-28783f3bf678 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:52.748575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9b2c9943-659a-4cf8-a27f-28783f3bf678 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:52.758904 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9b2c9943-659a-4cf8-a27f-28783f3bf678 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1210 microversion: 2.1 time: 0.171269 Dec 03 15:12:52.770568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 511/1043] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:52 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1210 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:53.783048 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-ccebf20c-48f5-4328-99c4-eedc4012911a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:53.784396 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-ccebf20c-48f5-4328-99c4-eedc4012911a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:53.792928 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccebf20c-48f5-4328-99c4-eedc4012911a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:53.793546 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccebf20c-48f5-4328-99c4-eedc4012911a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:53.794726 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccebf20c-48f5-4328-99c4-eedc4012911a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:53.795423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-ccebf20c-48f5-4328-99c4-eedc4012911a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:54.275242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-ccebf20c-48f5-4328-99c4-eedc4012911a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:54.284844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-ccebf20c-48f5-4328-99c4-eedc4012911a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.511887 Dec 03 15:12:54.285436 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 533/1044] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:53 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:55.307621 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f2f1d2d1-136d-457e-a290-53f9abea8e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:55.308464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f2f1d2d1-136d-457e-a290-53f9abea8e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:55.317232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f2f1d2d1-136d-457e-a290-53f9abea8e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:55.317864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f2f1d2d1-136d-457e-a290-53f9abea8e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:55.318613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f2f1d2d1-136d-457e-a290-53f9abea8e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:55.319110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-f2f1d2d1-136d-457e-a290-53f9abea8e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:55.566164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f2f1d2d1-136d-457e-a290-53f9abea8e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:55.578344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f2f1d2d1-136d-457e-a290-53f9abea8e48 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.278860 Dec 03 15:12:55.579325 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 512/1045] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:55 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:55.591178 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b2d3d366-1822-443c-8109-b0d20eab5c57 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:55.591983 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b2d3d366-1822-443c-8109-b0d20eab5c57 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:55.606017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2d3d366-1822-443c-8109-b0d20eab5c57 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:55.606647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2d3d366-1822-443c-8109-b0d20eab5c57 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:55.607902 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2d3d366-1822-443c-8109-b0d20eab5c57 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:55.609661 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b2d3d366-1822-443c-8109-b0d20eab5c57 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:55.613118 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-36482058-242f-4014-9d0d-a2cf71764dfb req-4a452b1c-590c-4df1-922f-58a8c0f5ab87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2af9f6a-6971-4c2c-b2f1-ede1e0da987d", "tag": "81d206c5-23dc-4936-b486-a60db5437ec7"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:12:55.621110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:12:55.621110 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:12:55.631459 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-36482058-242f-4014-9d0d-a2cf71764dfb req-4a452b1c-590c-4df1-922f-58a8c0f5ab87 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:55.632228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-36482058-242f-4014-9d0d-a2cf71764dfb req-4a452b1c-590c-4df1-922f-58a8c0f5ab87 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:55.653272 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-36482058-242f-4014-9d0d-a2cf71764dfb req-4a452b1c-590c-4df1-922f-58a8c0f5ab87 service nova] Creating event network-changed:81d206c5-23dc-4936-b486-a60db5437ec7 for instance c2af9f6a-6971-4c2c-b2f1-ede1e0da987d on hv-cinder-75790 Dec 03 15:12:55.660880 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-36482058-242f-4014-9d0d-a2cf71764dfb req-4a452b1c-590c-4df1-922f-58a8c0f5ab87 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171527 Dec 03 15:12:55.661547 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 534/1046] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:12:55 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:12:55.895446 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b2d3d366-1822-443c-8109-b0d20eab5c57 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "DELETE /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655/os-volume_attachments/d3a14b7a-3f3c-46af-b010-a759770be433" status: 202 len: 0 microversion: 2.1 time: 0.314537 Dec 03 15:12:55.896443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 513/1047] 10.222.0.63 () {58 vars in 1406 bytes} [Thu Dec 3 15:12:55 2020] DELETE /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655/os-volume_attachments/d3a14b7a-3f3c-46af-b010-a759770be433 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:12:56.603354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1f5cc0fa-886a-4a9e-b6af-4e6f44d9d00a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:56.604130 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1f5cc0fa-886a-4a9e-b6af-4e6f44d9d00a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:56.613723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f5cc0fa-886a-4a9e-b6af-4e6f44d9d00a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:56.614253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f5cc0fa-886a-4a9e-b6af-4e6f44d9d00a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:56.615106 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f5cc0fa-886a-4a9e-b6af-4e6f44d9d00a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:56.615592 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1f5cc0fa-886a-4a9e-b6af-4e6f44d9d00a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:56.966554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1f5cc0fa-886a-4a9e-b6af-4e6f44d9d00a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:56.977085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1f5cc0fa-886a-4a9e-b6af-4e6f44d9d00a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.384651 Dec 03 15:12:56.977699 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 535/1048] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:56 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:57.131628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-b7a19efe-da7d-4ce0-b47c-923142da86cb tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:57.132277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b7a19efe-da7d-4ce0-b47c-923142da86cb tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:57.140486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7a19efe-da7d-4ce0-b47c-923142da86cb tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:57.140991 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7a19efe-da7d-4ce0-b47c-923142da86cb tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:57.141833 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7a19efe-da7d-4ce0-b47c-923142da86cb tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:57.142351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-b7a19efe-da7d-4ce0-b47c-923142da86cb tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:57.212830 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-b7a19efe-da7d-4ce0-b47c-923142da86cb tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Going to try to terminate instance {{(pid=94373) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:12:57.329825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-b7a19efe-da7d-4ce0-b47c-923142da86cb tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "DELETE /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 204 len: 0 microversion: 2.1 time: 0.208577 Dec 03 15:12:57.330665 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 514/1049] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:12:57 2020] DELETE /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:12:57.344100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-53b9fbe8-8005-4f1b-9d06-c36eab1dbe80 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:57.344785 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-53b9fbe8-8005-4f1b-9d06-c36eab1dbe80 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:57.352616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53b9fbe8-8005-4f1b-9d06-c36eab1dbe80 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:57.353123 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53b9fbe8-8005-4f1b-9d06-c36eab1dbe80 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:57.354006 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53b9fbe8-8005-4f1b-9d06-c36eab1dbe80 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:57.354506 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-53b9fbe8-8005-4f1b-9d06-c36eab1dbe80 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:57.573534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-53b9fbe8-8005-4f1b-9d06-c36eab1dbe80 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:57.582656 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-53b9fbe8-8005-4f1b-9d06-c36eab1dbe80 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1515 microversion: 2.1 time: 0.247514 Dec 03 15:12:57.583223 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 536/1050] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:57 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:58.001100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-989f8cd5-07cc-4301-a5f0-7375b2d4f61a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:58.001885 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-989f8cd5-07cc-4301-a5f0-7375b2d4f61a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:58.009823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-989f8cd5-07cc-4301-a5f0-7375b2d4f61a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:58.010372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-989f8cd5-07cc-4301-a5f0-7375b2d4f61a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:58.011222 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-989f8cd5-07cc-4301-a5f0-7375b2d4f61a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:58.011720 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-989f8cd5-07cc-4301-a5f0-7375b2d4f61a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:58.373634 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-989f8cd5-07cc-4301-a5f0-7375b2d4f61a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:58.384624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-989f8cd5-07cc-4301-a5f0-7375b2d4f61a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.393376 Dec 03 15:12:58.385230 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 515/1051] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:57 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:58.607225 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-cae36786-e05a-402d-9aef-4ae7e442dd76 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:58.607809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-cae36786-e05a-402d-9aef-4ae7e442dd76 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:58.616528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cae36786-e05a-402d-9aef-4ae7e442dd76 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:58.617029 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cae36786-e05a-402d-9aef-4ae7e442dd76 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:58.617859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cae36786-e05a-402d-9aef-4ae7e442dd76 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:58.618379 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-cae36786-e05a-402d-9aef-4ae7e442dd76 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:58.836048 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-cae36786-e05a-402d-9aef-4ae7e442dd76 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:58.845581 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-cae36786-e05a-402d-9aef-4ae7e442dd76 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1515 microversion: 2.1 time: 0.247654 Dec 03 15:12:58.846965 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 537/1052] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:58 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:59.407544 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-898514d3-7dd9-44b4-a345-83004ce0bf2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:59.408208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-898514d3-7dd9-44b4-a345-83004ce0bf2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:59.416656 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-898514d3-7dd9-44b4-a345-83004ce0bf2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:59.417164 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-898514d3-7dd9-44b4-a345-83004ce0bf2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:59.418043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-898514d3-7dd9-44b4-a345-83004ce0bf2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:59.418539 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-898514d3-7dd9-44b4-a345-83004ce0bf2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:59.644657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-898514d3-7dd9-44b4-a345-83004ce0bf2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:12:59.653638 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-898514d3-7dd9-44b4-a345-83004ce0bf2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.255486 Dec 03 15:12:59.654265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 516/1053] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:59 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:12:59.870617 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-6ea6d0a5-1105-41d4-8632-a4fedb0e5f06 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:12:59.871213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-6ea6d0a5-1105-41d4-8632-a4fedb0e5f06 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:12:59.880255 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6ea6d0a5-1105-41d4-8632-a4fedb0e5f06 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:59.880765 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6ea6d0a5-1105-41d4-8632-a4fedb0e5f06 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:12:59.881624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6ea6d0a5-1105-41d4-8632-a4fedb0e5f06 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:12:59.882155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-6ea6d0a5-1105-41d4-8632-a4fedb0e5f06 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:00.081004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-6ea6d0a5-1105-41d4-8632-a4fedb0e5f06 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141130b4926443c19522e8f41aca97dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53373f86c5e745dea4811644f2dd6d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:00.090199 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-6ea6d0a5-1105-41d4-8632-a4fedb0e5f06 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 200 len: 1473 microversion: 2.1 time: 0.228782 Dec 03 15:13:00.090824 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 538/1054] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:12:59 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:00.178570 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-f7af1629-0cab-43c7-9cec-eb87e1df5fa1 req-739af3e5-545e-4b4e-95d8-c5db77f8efd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bac5f0-bc0a-483a-8511-637e1982d655", "name": "network-vif-deleted", "tag": "32c33f5f-f535-4def-8119-5ec04e44c6df"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:13:00.185534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:13:00.185534 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:13:00.194914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f7af1629-0cab-43c7-9cec-eb87e1df5fa1 req-739af3e5-545e-4b4e-95d8-c5db77f8efd0 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:00.195416 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-f7af1629-0cab-43c7-9cec-eb87e1df5fa1 req-739af3e5-545e-4b4e-95d8-c5db77f8efd0 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:00.213788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-f7af1629-0cab-43c7-9cec-eb87e1df5fa1 req-739af3e5-545e-4b4e-95d8-c5db77f8efd0 service nova] Creating event network-vif-deleted:32c33f5f-f535-4def-8119-5ec04e44c6df for instance 24bac5f0-bc0a-483a-8511-637e1982d655 on hv-cinder-75790 Dec 03 15:13:00.219561 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-f7af1629-0cab-43c7-9cec-eb87e1df5fa1 req-739af3e5-545e-4b4e-95d8-c5db77f8efd0 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050130 Dec 03 15:13:00.220202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 517/1055] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:13:00 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:13:00.677277 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-af00709b-666d-4536-b326-28d6d6765f9a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:00.678001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-af00709b-666d-4536-b326-28d6d6765f9a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:00.686030 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af00709b-666d-4536-b326-28d6d6765f9a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:00.686548 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af00709b-666d-4536-b326-28d6d6765f9a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:00.687402 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af00709b-666d-4536-b326-28d6d6765f9a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:00.687890 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-af00709b-666d-4536-b326-28d6d6765f9a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:00.918175 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-af00709b-666d-4536-b326-28d6d6765f9a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:00.927600 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-af00709b-666d-4536-b326-28d6d6765f9a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.260269 Dec 03 15:13:00.928207 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 539/1056] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:00 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:01.115844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:01.116613 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] [instance: 24bac5f0-bc0a-483a-8511-637e1982d655] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:01.125202 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:01.125622 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:01.126521 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:01.127010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:01.181487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] HTTP exception thrown: Instance 24bac5f0-bc0a-483a-8511-637e1982d655 could not be found. Dec 03 15:13:01.182099 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] Returning 404 to user: Instance 24bac5f0-bc0a-483a-8511-637e1982d655 could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:13:01.183254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c19b044c-6cf8-4161-a2c5-0db55801a927 tempest-VolumesSnapshotTestJSON-2017566459 tempest-VolumesSnapshotTestJSON-2017566459] 10.222.0.63 "GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655" status: 404 len: 111 microversion: 2.1 time: 0.077575 Dec 03 15:13:01.183869 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 518/1057] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:01 2020] GET /compute/v2.1/servers/24bac5f0-bc0a-483a-8511-637e1982d655 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:13:01.951260 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4a1ad48d-2d0d-4264-9230-ef60609e0257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:01.951919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4a1ad48d-2d0d-4264-9230-ef60609e0257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:01.960307 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a1ad48d-2d0d-4264-9230-ef60609e0257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:01.960806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a1ad48d-2d0d-4264-9230-ef60609e0257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:01.961642 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a1ad48d-2d0d-4264-9230-ef60609e0257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:01.962197 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a1ad48d-2d0d-4264-9230-ef60609e0257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:02.179058 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4a1ad48d-2d0d-4264-9230-ef60609e0257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:02.188704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4a1ad48d-2d0d-4264-9230-ef60609e0257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.246549 Dec 03 15:13:02.189296 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 540/1058] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:01 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:03.213317 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-0ea8da10-3bdf-479d-a132-f53bce87f1cf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:03.214004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-0ea8da10-3bdf-479d-a132-f53bce87f1cf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:03.222602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0ea8da10-3bdf-479d-a132-f53bce87f1cf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:03.223049 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0ea8da10-3bdf-479d-a132-f53bce87f1cf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:03.223882 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0ea8da10-3bdf-479d-a132-f53bce87f1cf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:03.224366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-0ea8da10-3bdf-479d-a132-f53bce87f1cf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:03.449003 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-0ea8da10-3bdf-479d-a132-f53bce87f1cf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:03.458423 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-0ea8da10-3bdf-479d-a132-f53bce87f1cf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.254952 Dec 03 15:13:03.459024 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 519/1059] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:03 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:04.481939 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-e928f2d7-93b9-42d3-81eb-44e3fc131a98 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:04.482485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-e928f2d7-93b9-42d3-81eb-44e3fc131a98 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:04.490969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e928f2d7-93b9-42d3-81eb-44e3fc131a98 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:04.491464 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e928f2d7-93b9-42d3-81eb-44e3fc131a98 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:04.492295 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e928f2d7-93b9-42d3-81eb-44e3fc131a98 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:04.492779 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-e928f2d7-93b9-42d3-81eb-44e3fc131a98 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:04.713474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-e928f2d7-93b9-42d3-81eb-44e3fc131a98 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:04.723032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-e928f2d7-93b9-42d3-81eb-44e3fc131a98 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.250443 Dec 03 15:13:04.723626 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 541/1060] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:04 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:05.746511 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1dcfe17b-a2bf-42df-b68a-a36775873caf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:05.747193 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1dcfe17b-a2bf-42df-b68a-a36775873caf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:05.755556 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1dcfe17b-a2bf-42df-b68a-a36775873caf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:05.756076 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1dcfe17b-a2bf-42df-b68a-a36775873caf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:05.756911 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1dcfe17b-a2bf-42df-b68a-a36775873caf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:05.757415 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1dcfe17b-a2bf-42df-b68a-a36775873caf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:05.975303 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1dcfe17b-a2bf-42df-b68a-a36775873caf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:05.984569 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1dcfe17b-a2bf-42df-b68a-a36775873caf tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.247298 Dec 03 15:13:05.985163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 520/1061] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:05 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:06.713217 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-ef18db3c-057c-4afb-893e-0d52444be771 req-4018c640-cb44-4b63-af1e-e6449f98f655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2af9f6a-6971-4c2c-b2f1-ede1e0da987d", "name": "network-vif-plugged", "status": "completed", "tag": "81d206c5-23dc-4936-b486-a60db5437ec7"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:13:06.720717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:13:06.720717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:13:06.729784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ef18db3c-057c-4afb-893e-0d52444be771 req-4018c640-cb44-4b63-af1e-e6449f98f655 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:06.730323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ef18db3c-057c-4afb-893e-0d52444be771 req-4018c640-cb44-4b63-af1e-e6449f98f655 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:06.748215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-ef18db3c-057c-4afb-893e-0d52444be771 req-4018c640-cb44-4b63-af1e-e6449f98f655 service nova] Creating event network-vif-plugged:81d206c5-23dc-4936-b486-a60db5437ec7 for instance c2af9f6a-6971-4c2c-b2f1-ede1e0da987d on hv-cinder-75790 Dec 03 15:13:06.754750 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-ef18db3c-057c-4afb-893e-0d52444be771 req-4018c640-cb44-4b63-af1e-e6449f98f655 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154894 Dec 03 15:13:06.755675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 542/1062] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:13:06 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:13:07.008160 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-edcf17e4-2b94-4a76-a334-f7511a4d1ffb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:07.008834 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-edcf17e4-2b94-4a76-a334-f7511a4d1ffb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:07.017510 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-edcf17e4-2b94-4a76-a334-f7511a4d1ffb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:07.018055 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-edcf17e4-2b94-4a76-a334-f7511a4d1ffb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:07.019004 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-edcf17e4-2b94-4a76-a334-f7511a4d1ffb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:07.019353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-edcf17e4-2b94-4a76-a334-f7511a4d1ffb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:07.312057 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-edcf17e4-2b94-4a76-a334-f7511a4d1ffb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:07.321280 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-edcf17e4-2b94-4a76-a334-f7511a4d1ffb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1273 microversion: 2.1 time: 0.322962 Dec 03 15:13:07.321872 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 521/1063] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:06 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:08.346485 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-86a7a7b9-ee6f-41e2-8a8e-9ce2469e20fb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:08.347254 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-86a7a7b9-ee6f-41e2-8a8e-9ce2469e20fb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:08.356639 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86a7a7b9-ee6f-41e2-8a8e-9ce2469e20fb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:08.357150 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86a7a7b9-ee6f-41e2-8a8e-9ce2469e20fb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:08.358032 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86a7a7b9-ee6f-41e2-8a8e-9ce2469e20fb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:08.358640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-86a7a7b9-ee6f-41e2-8a8e-9ce2469e20fb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:08.588854 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-86a7a7b9-ee6f-41e2-8a8e-9ce2469e20fb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:08.598823 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-86a7a7b9-ee6f-41e2-8a8e-9ce2469e20fb tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1459 microversion: 2.1 time: 0.262567 Dec 03 15:13:08.599360 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 543/1064] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:08 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1459 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:08.620848 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fc02750c-34d8-45d2-82e0-ed11ae9f387a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:13:08.621518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fc02750c-34d8-45d2-82e0-ed11ae9f387a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:08.636253 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc02750c-34d8-45d2-82e0-ed11ae9f387a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:08.636764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc02750c-34d8-45d2-82e0-ed11ae9f387a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:08.637644 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc02750c-34d8-45d2-82e0-ed11ae9f387a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:08.638218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fc02750c-34d8-45d2-82e0-ed11ae9f387a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:08.863772 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fc02750c-34d8-45d2-82e0-ed11ae9f387a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:13:08.872643 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fc02750c-34d8-45d2-82e0-ed11ae9f387a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1459 microversion: 2.1 time: 0.260840 Dec 03 15:13:08.873242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 522/1065] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:13:08 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1459 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:13:08.896183 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d6907b91-68b4-4ea8-a65e-dc1c35298337 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: .version_select at 0x7fd5f5894c80>, body: {"pool": null} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:13:11.170603 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d6907b91-68b4-4ea8-a65e-dc1c35298337 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.283868 Dec 03 15:13:11.171443 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 544/1066] 10.222.0.63 () {60 vars in 1160 bytes} [Thu Dec 3 15:13:08 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:13:11.188962 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.2.229"}} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:13:11.190207 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:13:11.198490 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:11.199015 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:11.199861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:11.200354 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:11.272566 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Acquired lock "refresh_cache-c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:13:13.189861 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Building network info cache for instance {{(pid=94373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:13:13.304528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-ea1ce91d-b945-4eb5-a904-95a497e5f3db req-1001cc35-5214-4417-8f47-337cb39427f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2af9f6a-6971-4c2c-b2f1-ede1e0da987d", "tag": "81d206c5-23dc-4936-b486-a60db5437ec7"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:13:13.311581 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:13:13.311581 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:13:13.321300 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ea1ce91d-b945-4eb5-a904-95a497e5f3db req-1001cc35-5214-4417-8f47-337cb39427f3 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:13:13.321855 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ea1ce91d-b945-4eb5-a904-95a497e5f3db req-1001cc35-5214-4417-8f47-337cb39427f3 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:13:13.339442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-ea1ce91d-b945-4eb5-a904-95a497e5f3db req-1001cc35-5214-4417-8f47-337cb39427f3 service nova] Creating event network-changed:81d206c5-23dc-4936-b486-a60db5437ec7 for instance c2af9f6a-6971-4c2c-b2f1-ede1e0da987d on hv-cinder-75790 Dec 03 15:13:13.344806 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-ea1ce91d-b945-4eb5-a904-95a497e5f3db req-1001cc35-5214-4417-8f47-337cb39427f3 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149495 Dec 03 15:13:13.345625 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 545/1067] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:13:13 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:13:14.081624 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Updating instance_info_cache with network_info: [{"id": "81d206c5-23dc-4936-b486-a60db5437ec7", "address": "fa:16:3e:e8:27:da", "network": {"id": "ca7902d6-3500-4f57-934f-b73bb22a6c84", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-395720009-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f470bb55fd724a97959cc14ef30e0db0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap81d206c5-23", "ovs_interfaceid": "81d206c5-23dc-4936-b486-a60db5437ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:13:14.093095 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Releasing lock "refresh_cache-c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:13:14.094640 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-3898c74d-70e7-47d4-be75-6c5f9a6cc65b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d/action" status: 202 len: 0 microversion: 2.1 time: 2.915099 Dec 03 15:13:14.095514 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 523/1068] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:13:11 2020] POST /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d/action => generated 0 bytes in 2916 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 15:14:07.506745 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:14:07.507351 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:14:07 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:14:59.303554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76f3452b-52ff-4871-aeaf-c73b4d70f369] AMQP server on 10.222.0.63:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 03 15:14:59.313246 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-879902748", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415978198", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1253914480"}], "block_device_mapping_v2": [{"uuid": "a51b5e64-2f76-4ab4-a269-27d85f76a7f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca7902d6-3500-4f57-934f-b73bb22a6c84"}]}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:14:59.499388 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] validate_networks() for [('ca7902d6-3500-4f57-934f-b73bb22a6c84', None, None, None)] {{(pid=94374) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 15:15:00.091781 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Flavor limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 15:15:00.092258 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Image limits 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 15:15:00.092799 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Flavor pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 15:15:00.093262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Image pref 0:0:0 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 15:15:00.093723 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.virt.hardware [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 15:15:00.103482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:00.103992 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:00.104935 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:00.105652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:00.124753 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for project f470bb55fd724a97959cc14ef30e0db0. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 15:15:00.129066 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.quota [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Getting quotas for user c3ba93c0e7ce4b0598807e3e3e2ec74a and project f470bb55fd724a97959cc14ef30e0db0. Resources: {'cores', 'instances', 'ram'} {{(pid=94374) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 15:15:00.242267 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Going to run 1 instances... {{(pid=94374) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 15:15:00.244807 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a51b5e64-2f76-4ab4-a269-27d85f76a7f0',volume_size=None,volume_type=None)] {{(pid=94374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 15:15:00.322283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] [76f3452b-52ff-4871-aeaf-c73b4d70f369] Reconnected to AMQP server on 10.222.0.63:5672 via [amqp] client with port 53066. Dec 03 15:15:00.425701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-432e278f-8a83-4d23-8119-93bdb261ca0f tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.124435 Dec 03 15:15:00.426451 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 546/1069] 10.222.0.63 () {60 vars in 1137 bytes} [Thu Dec 3 15:14:59 2020] POST /compute/v2.1/servers => generated 413 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 15:15:00.444917 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f3739f81-6c61-4be8-b54e-5019cc889d1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:00.445791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-f3739f81-6c61-4be8-b54e-5019cc889d1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:00.535434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-f3739f81-6c61-4be8-b54e-5019cc889d1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:00.543679 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f3739f81-6c61-4be8-b54e-5019cc889d1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1093 microversion: 2.1 time: 0.110588 Dec 03 15:15:00.544283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 524/1070] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:00 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1093 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:01.567576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-109d2c24-de66-49ed-ab23-6c879afa2493 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:01.568195 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-109d2c24-de66-49ed-ab23-6c879afa2493 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:01.577292 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-109d2c24-de66-49ed-ab23-6c879afa2493 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:01.577804 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-109d2c24-de66-49ed-ab23-6c879afa2493 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:01.578704 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-109d2c24-de66-49ed-ab23-6c879afa2493 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:01.579209 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-109d2c24-de66-49ed-ab23-6c879afa2493 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:01.740100 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-109d2c24-de66-49ed-ab23-6c879afa2493 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:01.749232 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-109d2c24-de66-49ed-ab23-6c879afa2493 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1209 microversion: 2.1 time: 0.192124 Dec 03 15:15:01.750250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 547/1071] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:01 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1209 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:02.773487 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fefb97b2-cd89-45a1-a87e-ee934f5bd200 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:02.774433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fefb97b2-cd89-45a1-a87e-ee934f5bd200 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:02.784504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fefb97b2-cd89-45a1-a87e-ee934f5bd200 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:02.785011 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fefb97b2-cd89-45a1-a87e-ee934f5bd200 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:02.785873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fefb97b2-cd89-45a1-a87e-ee934f5bd200 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:02.786389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fefb97b2-cd89-45a1-a87e-ee934f5bd200 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:03.013873 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fefb97b2-cd89-45a1-a87e-ee934f5bd200 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:03.024489 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fefb97b2-cd89-45a1-a87e-ee934f5bd200 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.260318 Dec 03 15:15:03.025362 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 525/1072] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:02 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:04.048793 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-1844e6a2-341f-4d5d-95be-aa19681f6257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:04.051010 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-1844e6a2-341f-4d5d-95be-aa19681f6257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:04.059809 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1844e6a2-341f-4d5d-95be-aa19681f6257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:04.060328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1844e6a2-341f-4d5d-95be-aa19681f6257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:04.061198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1844e6a2-341f-4d5d-95be-aa19681f6257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:04.061701 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-1844e6a2-341f-4d5d-95be-aa19681f6257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:04.466893 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-3cef8448-b060-4078-a96a-bd9f1d074271 req-ee7633bc-e139-42cb-afa4-d33a4bba405f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e", "tag": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:15:04.473702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:15:04.473702 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:15:04.485287 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-3cef8448-b060-4078-a96a-bd9f1d074271 req-ee7633bc-e139-42cb-afa4-d33a4bba405f service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:04.485973 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-3cef8448-b060-4078-a96a-bd9f1d074271 req-ee7633bc-e139-42cb-afa4-d33a4bba405f service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:04.507054 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-3cef8448-b060-4078-a96a-bd9f1d074271 req-ee7633bc-e139-42cb-afa4-d33a4bba405f service nova] Creating event network-changed:ceb070d9-5a5e-4fcb-937b-49429ef5d8f5 for instance 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e on hv-cinder-75790 Dec 03 15:15:04.512827 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-3cef8448-b060-4078-a96a-bd9f1d074271 req-ee7633bc-e139-42cb-afa4-d33a4bba405f service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066526 Dec 03 15:15:04.513620 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 526/1073] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:15:04 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:15:04.566878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-1844e6a2-341f-4d5d-95be-aa19681f6257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:04.575954 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-1844e6a2-341f-4d5d-95be-aa19681f6257 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.536141 Dec 03 15:15:04.576552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 548/1074] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:04 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:05.599748 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d01b0f60-2d2c-4bf0-9434-43a396f662df tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:05.600530 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-d01b0f60-2d2c-4bf0-9434-43a396f662df tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:05.608658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d01b0f60-2d2c-4bf0-9434-43a396f662df tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:05.609167 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d01b0f60-2d2c-4bf0-9434-43a396f662df tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:05.610091 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d01b0f60-2d2c-4bf0-9434-43a396f662df tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:05.610590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-d01b0f60-2d2c-4bf0-9434-43a396f662df tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:05.724389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb18f73d-f9f5-4180-83b0-56eea08ab748] AMQP server on 10.222.0.63:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 03 15:15:05.857658 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-d01b0f60-2d2c-4bf0-9434-43a396f662df tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:05.867372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d01b0f60-2d2c-4bf0-9434-43a396f662df tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.277550 Dec 03 15:15:05.867971 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 527/1075] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:05 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:06.890281 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-5f290fde-639f-410e-b78b-b77eb1f50572 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:06.890951 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-5f290fde-639f-410e-b78b-b77eb1f50572 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:06.899528 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5f290fde-639f-410e-b78b-b77eb1f50572 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:06.900043 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5f290fde-639f-410e-b78b-b77eb1f50572 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:06.900878 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5f290fde-639f-410e-b78b-b77eb1f50572 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:06.901371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-5f290fde-639f-410e-b78b-b77eb1f50572 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:07.122434 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-5f290fde-639f-410e-b78b-b77eb1f50572 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:07.132345 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-5f290fde-639f-410e-b78b-b77eb1f50572 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.251227 Dec 03 15:15:07.132930 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 549/1076] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:06 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:08.155641 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-9a39dc9c-7653-491e-b306-96d4aeef5161 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:08.156228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-9a39dc9c-7653-491e-b306-96d4aeef5161 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:08.180628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a39dc9c-7653-491e-b306-96d4aeef5161 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:08.181149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a39dc9c-7653-491e-b306-96d4aeef5161 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:08.182042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a39dc9c-7653-491e-b306-96d4aeef5161 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:08.182543 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-9a39dc9c-7653-491e-b306-96d4aeef5161 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:08.183243 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb18f73d-f9f5-4180-83b0-56eea08ab748] Reconnected to AMQP server on 10.222.0.63:5672 via [amqp] client with port 53092. Dec 03 15:15:08.404564 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-9a39dc9c-7653-491e-b306-96d4aeef5161 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:08.413760 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-9a39dc9c-7653-491e-b306-96d4aeef5161 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.267412 Dec 03 15:15:08.414333 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 528/1077] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:08 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:09.436850 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-08a42598-3838-4a07-aea5-028775d46d82 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:09.437525 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-08a42598-3838-4a07-aea5-028775d46d82 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:09.446013 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08a42598-3838-4a07-aea5-028775d46d82 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:09.446524 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08a42598-3838-4a07-aea5-028775d46d82 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:09.447357 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08a42598-3838-4a07-aea5-028775d46d82 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:09.447849 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08a42598-3838-4a07-aea5-028775d46d82 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:09.669683 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-08a42598-3838-4a07-aea5-028775d46d82 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:09.679047 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-08a42598-3838-4a07-aea5-028775d46d82 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.251624 Dec 03 15:15:09.679636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 550/1078] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:09 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:10.702919 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c854b94f-4d6e-4e26-8460-f92e64f89bff tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:10.703577 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-c854b94f-4d6e-4e26-8460-f92e64f89bff tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:10.712717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c854b94f-4d6e-4e26-8460-f92e64f89bff tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:10.713215 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c854b94f-4d6e-4e26-8460-f92e64f89bff tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:10.714133 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c854b94f-4d6e-4e26-8460-f92e64f89bff tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:10.714623 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-c854b94f-4d6e-4e26-8460-f92e64f89bff tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:10.933588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-c854b94f-4d6e-4e26-8460-f92e64f89bff tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:10.943149 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c854b94f-4d6e-4e26-8460-f92e64f89bff tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.250102 Dec 03 15:15:10.943751 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 529/1079] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:10 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:11.966996 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-bae7c624-448b-4112-b139-1687204c61d7 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:11.967675 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-bae7c624-448b-4112-b139-1687204c61d7 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:11.976594 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bae7c624-448b-4112-b139-1687204c61d7 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:11.977120 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bae7c624-448b-4112-b139-1687204c61d7 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:11.977976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bae7c624-448b-4112-b139-1687204c61d7 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:11.978486 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-bae7c624-448b-4112-b139-1687204c61d7 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:12.198738 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-bae7c624-448b-4112-b139-1687204c61d7 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:12.207794 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-bae7c624-448b-4112-b139-1687204c61d7 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.249897 Dec 03 15:15:12.208400 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 551/1080] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:11 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:12.886931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-345bd76a-ca64-4e94-83fd-c09461faf39b req-87b45154-7f38-49d1-85c3-c681b0f5c46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e", "name": "network-vif-plugged", "status": "completed", "tag": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:15:12.894213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:15:12.894213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:15:12.903117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-345bd76a-ca64-4e94-83fd-c09461faf39b req-87b45154-7f38-49d1-85c3-c681b0f5c46d service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:12.903618 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-345bd76a-ca64-4e94-83fd-c09461faf39b req-87b45154-7f38-49d1-85c3-c681b0f5c46d service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:12.921493 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-345bd76a-ca64-4e94-83fd-c09461faf39b req-87b45154-7f38-49d1-85c3-c681b0f5c46d service nova] Creating event network-vif-plugged:ceb070d9-5a5e-4fcb-937b-49429ef5d8f5 for instance 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e on hv-cinder-75790 Dec 03 15:15:12.926843 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-345bd76a-ca64-4e94-83fd-c09461faf39b req-87b45154-7f38-49d1-85c3-c681b0f5c46d service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050235 Dec 03 15:15:12.927500 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 530/1081] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:15:12 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:15:13.232655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-54c22bad-ae91-4600-86e2-1c34daca0a2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:13.233270 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-54c22bad-ae91-4600-86e2-1c34daca0a2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:13.241926 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54c22bad-ae91-4600-86e2-1c34daca0a2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:13.242468 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54c22bad-ae91-4600-86e2-1c34daca0a2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:13.243322 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54c22bad-ae91-4600-86e2-1c34daca0a2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:13.243828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-54c22bad-ae91-4600-86e2-1c34daca0a2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:13.463079 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-54c22bad-ae91-4600-86e2-1c34daca0a2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:13.471896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-54c22bad-ae91-4600-86e2-1c34daca0a2d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1272 microversion: 2.1 time: 0.249480 Dec 03 15:15:13.472482 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 552/1082] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:13 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:14.496238 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4171ba3a-eea7-4a81-8933-55e22c796aa9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:14.497020 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4171ba3a-eea7-4a81-8933-55e22c796aa9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:14.505759 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4171ba3a-eea7-4a81-8933-55e22c796aa9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:14.506335 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4171ba3a-eea7-4a81-8933-55e22c796aa9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:14.507187 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4171ba3a-eea7-4a81-8933-55e22c796aa9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:14.507687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4171ba3a-eea7-4a81-8933-55e22c796aa9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:14.960713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4171ba3a-eea7-4a81-8933-55e22c796aa9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:14.969659 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4171ba3a-eea7-4a81-8933-55e22c796aa9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1459 microversion: 2.1 time: 0.483496 Dec 03 15:15:14.970290 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 531/1083] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:14 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1459 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:14.993037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4a67c65d-ae2b-47c8-9e8d-64b04cf16a4b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:15:14.993717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4a67c65d-ae2b-47c8-9e8d-64b04cf16a4b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:15.001563 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a67c65d-ae2b-47c8-9e8d-64b04cf16a4b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:15.003298 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a67c65d-ae2b-47c8-9e8d-64b04cf16a4b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:15.004154 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a67c65d-ae2b-47c8-9e8d-64b04cf16a4b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:15.004654 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4a67c65d-ae2b-47c8-9e8d-64b04cf16a4b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:15.227795 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4a67c65d-ae2b-47c8-9e8d-64b04cf16a4b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:15:15.237204 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4a67c65d-ae2b-47c8-9e8d-64b04cf16a4b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1459 microversion: 2.1 time: 0.253990 Dec 03 15:15:15.237768 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 553/1084] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:15:14 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1459 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:15:15.260442 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-51883022-42e5-41a9-9a05-52f017645869 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'create', calling method: .version_select at 0x7fd5f61390d0>, body: {"pool": null} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:15:17.282688 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-51883022-42e5-41a9-9a05-52f017645869 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.031419 Dec 03 15:15:17.283330 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 532/1085] 10.222.0.63 () {60 vars in 1160 bytes} [Thu Dec 3 15:15:15 2020] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:15:17.300985 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.2.45"}} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:15:17.302328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:15:17.310433 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:17.310938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:17.311780 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:17.312265 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:17.382501 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Acquired lock "refresh_cache-26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:15:19.269382 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Building network info cache for instance {{(pid=94374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:15:19.282896 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-ebe3cdf3-1a15-4523-baf8-bf6b3080e20d req-bb211bbc-d87b-4514-949b-5532811e4d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e", "tag": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:15:19.289653 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:15:19.289653 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:15:19.299513 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ebe3cdf3-1a15-4523-baf8-bf6b3080e20d req-bb211bbc-d87b-4514-949b-5532811e4d8c service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:15:19.300285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-ebe3cdf3-1a15-4523-baf8-bf6b3080e20d req-bb211bbc-d87b-4514-949b-5532811e4d8c service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:15:19.318492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-ebe3cdf3-1a15-4523-baf8-bf6b3080e20d req-bb211bbc-d87b-4514-949b-5532811e4d8c service nova] Creating event network-changed:ceb070d9-5a5e-4fcb-937b-49429ef5d8f5 for instance 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e on hv-cinder-75790 Dec 03 15:15:19.323931 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-ebe3cdf3-1a15-4523-baf8-bf6b3080e20d req-bb211bbc-d87b-4514-949b-5532811e4d8c service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049968 Dec 03 15:15:19.324590 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 533/1086] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:15:19 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:15:20.841802 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Updating instance_info_cache with network_info: [{"id": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5", "address": "fa:16:3e:4e:f7:37", "network": {"id": "ca7902d6-3500-4f57-934f-b73bb22a6c84", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-395720009-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f470bb55fd724a97959cc14ef30e0db0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapceb070d9-5a", "ovs_interfaceid": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:15:20.854575 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Releasing lock "refresh_cache-26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" {{(pid=94374) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:15:20.855661 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-90c0518b-b8a8-4521-9eb3-6c3d64aa03cd tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "POST /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e/action" status: 202 len: 0 microversion: 2.1 time: 3.564842 Dec 03 15:15:20.861994 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 554/1087] 10.222.0.63 () {60 vars in 1268 bytes} [Thu Dec 3 15:15:17 2020] POST /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e/action => generated 0 bytes in 3566 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 15:15:26.153595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:15:26.154228 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:15:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:16:08.902219 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:16:08.902828 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:16:08 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:16:47.265693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '.version_select at 0x7fd5f61399d8>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:16:47.751666 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:16:47.760732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:47.761242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:47.762155 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:47.762652 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:47.825899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Acquired lock "refresh_cache-26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:16:49.740023 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Building network info cache for instance {{(pid=94373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:16:49.761576 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-eb44af29-4a4b-4d68-a24f-4c1ccbaf4b4a req-6d4431e1-4597-48b2-8a86-e64c6f706513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e", "tag": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:16:49.770002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:16:49.770002 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:16:49.780499 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-eb44af29-4a4b-4d68-a24f-4c1ccbaf4b4a req-6d4431e1-4597-48b2-8a86-e64c6f706513 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:49.781299 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-eb44af29-4a4b-4d68-a24f-4c1ccbaf4b4a req-6d4431e1-4597-48b2-8a86-e64c6f706513 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:49.801383 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-eb44af29-4a4b-4d68-a24f-4c1ccbaf4b4a req-6d4431e1-4597-48b2-8a86-e64c6f706513 service nova] Creating event network-changed:ceb070d9-5a5e-4fcb-937b-49429ef5d8f5 for instance 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e on hv-cinder-75790 Dec 03 15:16:49.807554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-eb44af29-4a4b-4d68-a24f-4c1ccbaf4b4a req-6d4431e1-4597-48b2-8a86-e64c6f706513 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061986 Dec 03 15:16:49.808218 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 555/1088] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:16:49 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:16:50.598936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Updating instance_info_cache with network_info: [{"id": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5", "address": "fa:16:3e:4e:f7:37", "network": {"id": "ca7902d6-3500-4f57-934f-b73bb22a6c84", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-395720009-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f470bb55fd724a97959cc14ef30e0db0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapceb070d9-5a", "ovs_interfaceid": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:16:50.610582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Releasing lock "refresh_cache-26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:16:50.611631 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4d99fc55-f882-4ba9-b27b-8ec677096f1a tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/os-floating-ips/503cced8-7f8e-49ee-b74f-222801a4c510" status: 202 len: 0 microversion: 2.1 time: 3.356243 Dec 03 15:16:50.612568 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 534/1089] 10.222.0.63 () {58 vars in 1253 bytes} [Thu Dec 3 15:16:47 2020] DELETE /compute/v2.1/os-floating-ips/503cced8-7f8e-49ee-b74f-222801a4c510 => generated 0 bytes in 3358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:16:50.628231 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-be287b01-3346-4578-9cc6-08bd58e4f106 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:16:50.629035 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-be287b01-3346-4578-9cc6-08bd58e4f106 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:16:50.637980 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-be287b01-3346-4578-9cc6-08bd58e4f106 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:50.638586 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-be287b01-3346-4578-9cc6-08bd58e4f106 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:50.639526 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-be287b01-3346-4578-9cc6-08bd58e4f106 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:50.640096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-be287b01-3346-4578-9cc6-08bd58e4f106 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:50.716380 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-be287b01-3346-4578-9cc6-08bd58e4f106 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:16:50.863925 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-be287b01-3346-4578-9cc6-08bd58e4f106 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 204 len: 0 microversion: 2.1 time: 0.246072 Dec 03 15:16:50.864898 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 556/1090] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:16:50 2020] DELETE /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:16:50.880603 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-8cb38915-5ccb-423f-afde-67a8e2a03463 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:16:50.881285 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-8cb38915-5ccb-423f-afde-67a8e2a03463 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:16:50.889372 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cb38915-5ccb-423f-afde-67a8e2a03463 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:50.889886 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cb38915-5ccb-423f-afde-67a8e2a03463 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:50.890825 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cb38915-5ccb-423f-afde-67a8e2a03463 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:50.891944 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-8cb38915-5ccb-423f-afde-67a8e2a03463 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:51.134816 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-8cb38915-5ccb-423f-afde-67a8e2a03463 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:16:51.143754 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-8cb38915-5ccb-423f-afde-67a8e2a03463 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1465 microversion: 2.1 time: 0.274291 Dec 03 15:16:51.144350 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 535/1091] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:16:50 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1465 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:16:52.169835 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a963a6df-afa3-49a6-a0db-71fbc0186950 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:16:52.170632 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a963a6df-afa3-49a6-a0db-71fbc0186950 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:16:52.178717 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a963a6df-afa3-49a6-a0db-71fbc0186950 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:52.179229 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a963a6df-afa3-49a6-a0db-71fbc0186950 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:52.180059 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a963a6df-afa3-49a6-a0db-71fbc0186950 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:52.180552 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a963a6df-afa3-49a6-a0db-71fbc0186950 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:52.403021 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-a963a6df-afa3-49a6-a0db-71fbc0186950 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:16:52.411986 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a963a6df-afa3-49a6-a0db-71fbc0186950 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1465 microversion: 2.1 time: 0.252195 Dec 03 15:16:52.412588 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 557/1092] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:16:52 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1465 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:16:53.436347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4963d892-99f1-4d49-9948-27c5958a46b1 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:16:53.437025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4963d892-99f1-4d49-9948-27c5958a46b1 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:16:53.445136 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4963d892-99f1-4d49-9948-27c5958a46b1 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:53.445655 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4963d892-99f1-4d49-9948-27c5958a46b1 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:53.446542 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4963d892-99f1-4d49-9948-27c5958a46b1 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:53.447042 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4963d892-99f1-4d49-9948-27c5958a46b1 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:53.589310 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-4963d892-99f1-4d49-9948-27c5958a46b1 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:16:53.598832 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4963d892-99f1-4d49-9948-27c5958a46b1 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1390 microversion: 2.1 time: 0.171999 Dec 03 15:16:53.599428 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 536/1093] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:16:53 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:16:53.646630 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-77f59ae1-ccdd-47f2-a4e7-23541f66bbd1 req-c4058cf2-3714-4563-af9a-7634d0237aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e", "name": "network-vif-deleted", "tag": "ceb070d9-5a5e-4fcb-937b-49429ef5d8f5"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:16:53.653941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:16:53.653941 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:16:53.663492 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-77f59ae1-ccdd-47f2-a4e7-23541f66bbd1 req-c4058cf2-3714-4563-af9a-7634d0237aba service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:53.663997 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-77f59ae1-ccdd-47f2-a4e7-23541f66bbd1 req-c4058cf2-3714-4563-af9a-7634d0237aba service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:53.681687 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-77f59ae1-ccdd-47f2-a4e7-23541f66bbd1 req-c4058cf2-3714-4563-af9a-7634d0237aba service nova] Creating event network-vif-deleted:ceb070d9-5a5e-4fcb-937b-49429ef5d8f5 for instance 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e on hv-cinder-75790 Dec 03 15:16:53.686936 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-77f59ae1-ccdd-47f2-a4e7-23541f66bbd1 req-c4058cf2-3714-4563-af9a-7634d0237aba service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051195 Dec 03 15:16:53.688117 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 558/1094] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:16:53 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:16:54.621978 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:16:54.622656 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:16:54.630976 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:54.631474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:54.632332 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:54.632784 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:54.712829 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:54.713329 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:54.713841 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.objects.instance [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lazy-loading 'fault' on Instance uuid 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e {{(pid=94373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 15:16:54.783692 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:16:54.792163 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2916a59c-767f-4981-8edb-4bf06eb648ec tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 200 len: 1183 microversion: 2.1 time: 0.179396 Dec 03 15:16:54.792761 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 537/1095] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:16:54 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 1183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:16:55.816865 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:16:55.817636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:16:55.826041 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:55.826554 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:55.827398 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:55.827893 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:55.882083 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] HTTP exception thrown: Instance 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e could not be found. Dec 03 15:16:55.882747 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Returning 404 to user: Instance 26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:16:55.883647 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-08fc7bdc-767d-420c-bf03-bbb143596d59 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e" status: 404 len: 111 microversion: 2.1 time: 0.077024 Dec 03 15:16:55.884262 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 559/1096] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:16:55 2020] GET /compute/v2.1/servers/26d9f5d8-6d5a-401b-80ab-2b34f41b6b5e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:16:58.335582 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '.version_select at 0x7fd5f69aff28>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:16:58.826328 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:16:58.835250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:58.835789 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:58.836628 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:16:58.837132 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:16:58.900707 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Acquired lock "refresh_cache-c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 15:17:00.810540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Building network info cache for instance {{(pid=94373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 15:17:00.825198 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-fac044e7-907c-4903-bdaf-c5c10a2928fb req-cde0e9a6-22e3-4cc1-8928-201879573514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2af9f6a-6971-4c2c-b2f1-ede1e0da987d", "tag": "81d206c5-23dc-4936-b486-a60db5437ec7"}]} {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:17:00.832075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:17:00.832075 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:17:00.841283 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-fac044e7-907c-4903-bdaf-c5c10a2928fb req-cde0e9a6-22e3-4cc1-8928-201879573514 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:00.841788 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-fac044e7-907c-4903-bdaf-c5c10a2928fb req-cde0e9a6-22e3-4cc1-8928-201879573514 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:00.860092 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-fac044e7-907c-4903-bdaf-c5c10a2928fb req-cde0e9a6-22e3-4cc1-8928-201879573514 service nova] Creating event network-changed:81d206c5-23dc-4936-b486-a60db5437ec7 for instance c2af9f6a-6971-4c2c-b2f1-ede1e0da987d on hv-cinder-75790 Dec 03 15:17:00.865327 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-fac044e7-907c-4903-bdaf-c5c10a2928fb req-cde0e9a6-22e3-4cc1-8928-201879573514 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049128 Dec 03 15:17:00.866390 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 560/1097] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:17:00 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:17:01.595914 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.network.neutron [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Updating instance_info_cache with network_info: [{"id": "81d206c5-23dc-4936-b486-a60db5437ec7", "address": "fa:16:3e:e8:27:da", "network": {"id": "ca7902d6-3500-4f57-934f-b73bb22a6c84", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-395720009-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f470bb55fd724a97959cc14ef30e0db0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap81d206c5-23", "ovs_interfaceid": "81d206c5-23dc-4936-b486-a60db5437ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 15:17:01.607998 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Releasing lock "refresh_cache-c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" {{(pid=94373) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 15:17:01.608940 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-a2f45c5f-f812-47a9-906d-8e8d87e80593 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/os-floating-ips/15c29b56-f3ea-4a58-96ad-ec2a8f68cf28" status: 202 len: 0 microversion: 2.1 time: 3.283300 Dec 03 15:17:01.610353 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 538/1098] 10.222.0.63 () {58 vars in 1253 bytes} [Thu Dec 3 15:16:58 2020] DELETE /compute/v2.1/os-floating-ips/15c29b56-f3ea-4a58-96ad-ec2a8f68cf28 => generated 0 bytes in 3285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:17:01.625724 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-69e2579a-8b3a-4d52-bad5-7ec5f6d0e83c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:01.626670 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-69e2579a-8b3a-4d52-bad5-7ec5f6d0e83c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:17:01.634899 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-69e2579a-8b3a-4d52-bad5-7ec5f6d0e83c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:01.635414 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-69e2579a-8b3a-4d52-bad5-7ec5f6d0e83c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:01.636263 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-69e2579a-8b3a-4d52-bad5-7ec5f6d0e83c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:01.636756 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-69e2579a-8b3a-4d52-bad5-7ec5f6d0e83c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:01.711529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-69e2579a-8b3a-4d52-bad5-7ec5f6d0e83c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Going to try to terminate instance {{(pid=94374) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 15:17:01.881940 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-69e2579a-8b3a-4d52-bad5-7ec5f6d0e83c tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 204 len: 0 microversion: 2.1 time: 0.266427 Dec 03 15:17:01.882603 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 561/1099] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:17:01 2020] DELETE /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 15:17:01.897344 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-65494206-79e6-4bf6-ad21-a41f1b101732 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:01.898037 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-65494206-79e6-4bf6-ad21-a41f1b101732 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:17:01.906774 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-65494206-79e6-4bf6-ad21-a41f1b101732 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:01.907274 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-65494206-79e6-4bf6-ad21-a41f1b101732 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:01.908124 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-65494206-79e6-4bf6-ad21-a41f1b101732 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:01.908614 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-65494206-79e6-4bf6-ad21-a41f1b101732 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:02.159313 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-65494206-79e6-4bf6-ad21-a41f1b101732 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94373) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:17:02.168866 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-65494206-79e6-4bf6-ad21-a41f1b101732 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1465 microversion: 2.1 time: 0.281489 Dec 03 15:17:02.169474 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 539/1100] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:17:01 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1465 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:17:03.194412 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-fd186466-c97e-4ae9-9beb-ac009385298b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:03.195101 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-fd186466-c97e-4ae9-9beb-ac009385298b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:17:03.203504 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd186466-c97e-4ae9-9beb-ac009385298b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:03.204096 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd186466-c97e-4ae9-9beb-ac009385298b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:03.204879 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd186466-c97e-4ae9-9beb-ac009385298b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:03.205368 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-fd186466-c97e-4ae9-9beb-ac009385298b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:03.445417 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-fd186466-c97e-4ae9-9beb-ac009385298b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:17:03.454371 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-fd186466-c97e-4ae9-9beb-ac009385298b tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1465 microversion: 2.1 time: 0.270315 Dec 03 15:17:03.454972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 562/1101] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:17:03 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1465 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:17:03.670693 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-b869cf8f-0870-4ed7-b79d-e853a66b083a req-aa202d07-e826-43b8-b9f4-510b758b7e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2af9f6a-6971-4c2c-b2f1-ede1e0da987d", "name": "network-vif-unplugged", "status": "completed", "tag": "81d206c5-23dc-4936-b486-a60db5437ec7"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:17:03.680122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:17:03.680122 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:17:03.692732 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-b869cf8f-0870-4ed7-b79d-e853a66b083a req-aa202d07-e826-43b8-b9f4-510b758b7e29 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:03.693557 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-b869cf8f-0870-4ed7-b79d-e853a66b083a req-aa202d07-e826-43b8-b9f4-510b758b7e29 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:03.712938 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-b869cf8f-0870-4ed7-b79d-e853a66b083a req-aa202d07-e826-43b8-b9f4-510b758b7e29 service nova] Creating event network-vif-unplugged:81d206c5-23dc-4936-b486-a60db5437ec7 for instance c2af9f6a-6971-4c2c-b2f1-ede1e0da987d on hv-cinder-75790 Dec 03 15:17:03.718323 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-b869cf8f-0870-4ed7-b79d-e853a66b083a req-aa202d07-e826-43b8-b9f4-510b758b7e29 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061976 Dec 03 15:17:03.720242 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 540/1102] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:17:03 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 15:17:04.478060 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-2a93d2ea-7b79-4836-bfcc-0e67a764c0a8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:04.478746 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-2a93d2ea-7b79-4836-bfcc-0e67a764c0a8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:17:04.487467 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a93d2ea-7b79-4836-bfcc-0e67a764c0a8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:04.487984 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a93d2ea-7b79-4836-bfcc-0e67a764c0a8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:04.488844 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a93d2ea-7b79-4836-bfcc-0e67a764c0a8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:04.489342 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-2a93d2ea-7b79-4836-bfcc-0e67a764c0a8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:04.575737 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [req-232f7eac-0699-4744-845a-70b717ffdac2 req-87b95045-2655-4622-94b3-5436a0043346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2af9f6a-6971-4c2c-b2f1-ede1e0da987d", "name": "network-vif-deleted", "tag": "81d206c5-23dc-4936-b486-a60db5437ec7"}]} {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 15:17:04.583389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 15:17:04.583389 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: warnings.warn(msg) Dec 03 15:17:04.592580 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-232f7eac-0699-4744-845a-70b717ffdac2 req-87b95045-2655-4622-94b3-5436a0043346 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:04.593085 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [req-232f7eac-0699-4744-845a-70b717ffdac2 req-87b95045-2655-4622-94b3-5436a0043346 service nova] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:04.612401 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.compute.server_external_events [req-232f7eac-0699-4744-845a-70b717ffdac2 req-87b95045-2655-4622-94b3-5436a0043346 service nova] Creating event network-vif-deleted:81d206c5-23dc-4936-b486-a60db5437ec7 for instance c2af9f6a-6971-4c2c-b2f1-ede1e0da987d on hv-cinder-75790 Dec 03 15:17:04.618591 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [req-232f7eac-0699-4744-845a-70b717ffdac2 req-87b95045-2655-4622-94b3-5436a0043346 service nova] 10.222.0.63 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053049 Dec 03 15:17:04.619450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 541/1103] 10.222.0.63 () {64 vars in 1308 bytes} [Thu Dec 3 15:17:04 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 15:17:04.643969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.policy [None req-2a93d2ea-7b79-4836-bfcc-0e67a764c0a8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ba93c0e7ce4b0598807e3e3e2ec74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f470bb55fd724a97959cc14ef30e0db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94374) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 15:17:04.655017 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-2a93d2ea-7b79-4836-bfcc-0e67a764c0a8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 200 len: 1390 microversion: 2.1 time: 0.186373 Dec 03 15:17:04.655969 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 563/1104] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:17:04 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 15:17:05.679636 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:05.680518 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: c2af9f6a-6971-4c2c-b2f1-ede1e0da987d] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:17:05.689602 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:05.690211 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:05.690997 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:05.691494 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:05.744595 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] HTTP exception thrown: Instance c2af9f6a-6971-4c2c-b2f1-ede1e0da987d could not be found. Dec 03 15:17:05.745250 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Returning 404 to user: Instance c2af9f6a-6971-4c2c-b2f1-ede1e0da987d could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:17:05.746181 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-38defab0-25f5-465a-98fa-2e3a65465fda tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d" status: 404 len: 111 microversion: 2.1 time: 0.076446 Dec 03 15:17:05.747073 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 542/1105] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:17:05 2020] GET /compute/v2.1/servers/c2af9f6a-6971-4c2c-b2f1-ede1e0da987d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:17:05.773190 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-f49846b1-55ec-49c2-b730-bf529eb4aba9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '.version_select at 0x7fd5f58946a8>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:07.318403 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-f49846b1-55ec-49c2-b730-bf529eb4aba9 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/os-floating-ips/ded71b9f-e3b6-4072-9068-f5c30ec58e01" status: 202 len: 0 microversion: 2.1 time: 1.565756 Dec 03 15:17:07.319138 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 564/1106] 10.222.0.63 () {58 vars in 1253 bytes} [Thu Dec 3 15:17:05 2020] DELETE /compute/v2.1/os-floating-ips/ded71b9f-e3b6-4072-9068-f5c30ec58e01 => generated 0 bytes in 1568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:17:07.333616 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:07.334200 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94373) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:17:07.342034 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:07.342540 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:07.343381 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:07.344001 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94373) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:07.396612 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] HTTP exception thrown: Instance f0423581-5320-4d03-8e5c-2fc88bf1837b could not be found. Dec 03 15:17:07.397271 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Returning 404 to user: Instance f0423581-5320-4d03-8e5c-2fc88bf1837b could not be found. {{(pid=94373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:17:07.398192 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-4d6cbf56-01b0-456a-adaf-526193b6e40d tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 404 len: 111 microversion: 2.1 time: 0.074408 Dec 03 15:17:07.398791 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 543/1107] 10.222.0.63 () {58 vars in 1229 bytes} [Thu Dec 3 15:17:07 2020] DELETE /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:17:07.413070 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:07.413749 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.compute.api [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [instance: f0423581-5320-4d03-8e5c-2fc88bf1837b] Fetching instance by UUID {{(pid=94374) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 15:17:07.426347 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:07.426864 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:07.427713 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 15:17:07.428213 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG oslo_concurrency.lockutils [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Lock "c87cfc1d-53de-458d-8ab1-34bf80d29b3b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94374) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 15:17:07.480836 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.wsgi [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] HTTP exception thrown: Instance f0423581-5320-4d03-8e5c-2fc88bf1837b could not be found. Dec 03 15:17:07.481498 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Returning 404 to user: Instance f0423581-5320-4d03-8e5c-2fc88bf1837b could not be found. {{(pid=94374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 15:17:07.482452 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-eec6a8ec-ae95-4500-a6e3-572775fb2268 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b" status: 404 len: 111 microversion: 2.1 time: 0.079079 Dec 03 15:17:07.483053 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 565/1108] 10.222.0.63 () {58 vars in 1226 bytes} [Thu Dec 3 15:17:07 2020] GET /compute/v2.1/servers/f0423581-5320-4d03-8e5c-2fc88bf1837b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 15:17:08.748909 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-d6bcc32e-7fe6-44c2-a45c-5f75e02746e8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '.version_select at 0x7fd5f69afa60>' {{(pid=94373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:09.000103 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-d6bcc32e-7fe6-44c2-a45c-5f75e02746e8 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/os-security-groups/d1b57de3-957d-4a2e-a4de-5c259d445835" status: 202 len: 0 microversion: 2.1 time: 0.260524 Dec 03 15:17:09.000777 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94373|app: 0|req: 544/1109] 10.222.0.63 () {58 vars in 1262 bytes} [Thu Dec 3 15:17:08 2020] DELETE /compute/v2.1/os-security-groups/d1b57de3-957d-4a2e-a4de-5c259d445835 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:17:09.016764 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: DEBUG nova.api.openstack.wsgi [None req-c84ad886-f7b0-440b-8245-3d8a861cc862 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] Calling method '.version_select at 0x7fd5fabe8620>' {{(pid=94374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 15:17:09.025025 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c84ad886-f7b0-440b-8245-3d8a861cc862 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [7e1f05b0-79b2-4bb4-945b-4126def00a0a] AMQP server on 10.222.0.63:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 03 15:17:10.043529 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [None req-c84ad886-f7b0-440b-8245-3d8a861cc862 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] [7e1f05b0-79b2-4bb4-945b-4126def00a0a] Reconnected to AMQP server on 10.222.0.63:5672 via [amqp] client with port 53210. Dec 03 15:17:10.063657 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO nova.api.openstack.requestlog [None req-c84ad886-f7b0-440b-8245-3d8a861cc862 tempest-TestVolumeBootPattern-974514873 tempest-TestVolumeBootPattern-974514873] 10.222.0.63 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-415978198" status: 202 len: 0 microversion: 2.1 time: 1.058211 Dec 03 15:17:10.064334 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: [pid: 94374|app: 0|req: 566/1110] 10.222.0.63 () {58 vars in 1250 bytes} [Thu Dec 3 15:17:09 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-415978198 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 15:17:17.315421 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:17:17.315956 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:17:17 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:17:40.393208 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:17:40.393859 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:17:40 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:18:46.183979 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:18:46.184579 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:18:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:19:28.920549 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:19:28.921098 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:19:28 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:20:37.342609 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:20:37.343210 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:20:37 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:21:00.412583 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:21:00.413216 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:21:00 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:22:06.202633 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:22:06.203194 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:22:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:22:27.529680 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:22:27.530392 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:22:27 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:22:42.345366 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:22:42.345972 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:22:42 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 15:22:48.938923 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 15:22:48.939450 dv-cinder-757908-3-iscsi devstack@n-api.service[94371]: Thu Dec 3 15:22:48 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!